-- Logs begin at Wed 2022-07-06 12:57:08 UTC, end at Wed 2022-07-06 14:13:28 UTC. -- Jul 06 13:32:57.482197 dv-cinder-819149-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 06 13:32:57.489429 dv-cinder-819149-8-smb devstack@keystone.service[86838]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 13:32:57 2022] *** Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: nodename: dv-cinder-819149-8-smb Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: machine: x86_64 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: clock source: unix Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: pcre jit disabled Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: detected number of CPU cores: 4 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: current working directory: / Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: detected binary path: /usr/bin/uwsgi-core Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: your processes number limit is 47680 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: your memory page size is 4096 bytes Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: detected max file descriptor number: 2048 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: lock engine: pthread robust mutexes Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: thunder lock: enabled Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 06 13:32:57.493948 dv-cinder-819149-8-smb devstack@keystone.service[86838]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 13:32:57.539538 dv-cinder-819149-8-smb devstack@keystone.service[86838]: Python main interpreter initialized at 0x564ddf6949c0 Jul 06 13:32:57.539538 dv-cinder-819149-8-smb devstack@keystone.service[86838]: python threads support enabled Jul 06 13:32:57.539538 dv-cinder-819149-8-smb devstack@keystone.service[86838]: your server socket listen backlog is limited to 100 connections Jul 06 13:32:57.539538 dv-cinder-819149-8-smb devstack@keystone.service[86838]: your mercy for graceful operations on workers is 90 seconds Jul 06 13:32:57.539917 dv-cinder-819149-8-smb devstack@keystone.service[86838]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 13:32:57.539994 dv-cinder-819149-8-smb devstack@keystone.service[86838]: *** Operational MODE: preforking *** Jul 06 13:32:57.540246 dv-cinder-819149-8-smb devstack@keystone.service[86838]: *** uWSGI is running in multiple interpreter mode *** Jul 06 13:32:57.540246 dv-cinder-819149-8-smb devstack@keystone.service[86838]: spawned uWSGI master process (pid: 86838) Jul 06 13:32:57.540452 dv-cinder-819149-8-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 06 13:32:57.541438 dv-cinder-819149-8-smb devstack@keystone.service[86838]: spawned uWSGI worker 1 (pid: 86852, cores: 1) Jul 06 13:32:57.541438 dv-cinder-819149-8-smb devstack@keystone.service[86838]: spawned uWSGI worker 2 (pid: 86853, cores: 1) Jul 06 13:32:57.541594 dv-cinder-819149-8-smb devstack@keystone.service[86838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 13:33:02.934739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:33:02.934739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: from cryptography.utils import int_from_bytes Jul 06 13:33:02.935523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:33:02.935523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: from cryptography.utils import int_from_bytes Jul 06 13:33:02.939714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:33:02.939714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: from cryptography.utils import int_from_bytes Jul 06 13:33:02.940172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 13:33:02.940172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: from cryptography.utils import int_from_bytes Jul 06 13:33:02.984459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 13:33:02.984669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 13:33:02.984862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] command line args: [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 13:33:02.985128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 13:33:02.985303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ================================================================================ {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 13:33:02.985552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] admin_token = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.986315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] config_dir = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.986406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 13:33:02.986506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.986618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 13:33:02.986705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] config_source = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.986836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] command line args: [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 13:33:02.986920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] debug = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.987045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.987299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 13:33:02.987299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ================================================================================ {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 13:33:02.987457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.987595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] admin_token = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.987674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.987843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] config_dir = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.987924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] config_source = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] debug = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_config_append = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.988805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_dir = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_file = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_config_append = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.989990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_dir = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_file = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.990937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.991905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.992931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] publish_errors = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.993803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] standard_threads = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] publish_errors = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994898 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.994975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] use_journal = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] use_json = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] use_stderr = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] use_syslog = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] standard_threads = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.995897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.996061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.996138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.996240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.996326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.996423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] use_journal = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.996556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.996641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] use_json = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.996763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] use_stderr = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.996849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.996927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] use_syslog = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.997027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 13:33:02.997264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.997987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.998968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:02.999967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.000916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.001082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.001168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.001325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.002967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.003993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.004910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.005999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.006922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007233 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.007956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.008929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.009985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.010932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.011915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.012960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.013911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.014997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.015962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.016990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.017954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.018867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.019981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.020996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.external = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.021932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.password = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] auth.token = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.022901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.external = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.023858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.password = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] auth.token = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.024964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.025977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.026944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.027941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.028895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.029848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.030944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.031923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.032002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.032156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.032312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.032388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.032458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.033938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.034866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.035998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.036939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.037979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.038901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.039869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.040952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.041960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042574 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.042892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.043994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.044943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.045974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.046881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047595 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.047980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.048068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.048222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.048907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.049971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.050991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.051948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.052897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.053983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.054916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] role.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] role.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.055891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.056914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] role.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] role.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.057873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.058984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.059971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.060851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.061995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.062964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.063937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.064989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.065915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.066860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.067991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.connection = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.068938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.069955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.connection = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.070903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.071871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 13:33:03.072732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.072944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.073178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.073421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.073650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.073889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.074124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 13:33:03.074294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 13:33:03.103297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.103549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.103775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.104136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.104372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.104598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.112613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.113624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.140132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.140362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.141043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.141278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.281414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.281836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.329881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.330063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.330624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.330863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.393867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.394920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.395013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.395141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.395353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.419478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.420650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.420650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.420650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.421986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.432869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.436816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.446107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.446468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.446658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.446809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.447028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.447269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.447479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86853) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.449940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.450437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.450933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.451205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.451449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.451669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.451884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 13:33:03.466585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.466800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 13:33:03.467138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.467353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 13:33:03.467630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.467891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.468017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.468171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 13:33:03.468320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.468446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.468583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.468711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 13:33:03.468890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.469151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.469407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.469663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.479762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.480041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.480306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.480583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.481158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.481437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.481712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.481992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.488899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.490219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.492182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.492460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.492742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.493022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.493304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.493515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.493645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.493801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.493928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.494959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.495106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.495404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.495676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.495945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.496209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.521566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.523167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.523471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.523601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.525136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.525413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.528709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.528989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.529383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.530643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.530922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.531203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.537500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.537783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.539368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.539653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.544132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.544421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.544704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.544986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.545124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.545369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.545721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.545847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.545988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.546188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.546323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.546477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.546615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.546741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.547016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.547285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.565140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.565414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.565974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.566249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.569953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.570817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.573583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.573875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.574448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.574740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.579331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.580418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.583460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.584008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.587073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.587391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.587640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.588896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.589050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.589325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.608211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.608492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.608758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.608882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.609021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.609148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.609359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.609626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.616922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.617529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.618874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.619152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.619287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.619495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.622415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.622659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.622787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.622918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.623046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.623201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.623356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.623493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.623619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.623755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.637120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.637325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.637466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.637611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.637746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.637877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.638015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.638147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.638278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.638408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.638549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.638725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.639993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.640283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.658760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.659062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.662048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.662324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.665343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.665632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.666938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.667380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.668714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.668993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.669120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.669270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.669396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.669538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.677055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.677369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.678653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.678961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.681903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.682193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.682322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.682474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.682600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.682751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.682889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.683124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.692496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.692783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.692922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.693058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.693187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.693341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.700887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.701168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.701304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86853) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 13:33:03.701436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.701565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.701693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.701821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.701959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.702921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.703955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.704092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.704219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.704345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.704470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.704595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.704719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86853) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 13:33:03.742781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ddf6949c0 pid: 86852 (default app) Jul 06 13:33:03.742934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ddf6949c0 pid: 86853 (default app) Jul 06 13:33:03.746102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff4f8-f409-4b6e-af79-7d1552d3c0dd None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:03.746396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff4f8-f409-4b6e-af79-7d1552d3c0dd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:03.746672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff4f8-f409-4b6e-af79-7d1552d3c0dd None None] PATH_INFO: `/v3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:03.750901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Wed Jul 6 13:33:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:11.278458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:11.279005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:11.279005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:11.283936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:11.288859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:11.289270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:11.289415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:11.358314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: INFO dbcounter [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] Registered counter for database keystone Jul 06 13:33:11.379593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG oslo_db.sqlalchemy.engines [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:33:11.385645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writer thread running {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:33:11.561368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG passlib.handlers.bcrypt [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86852) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 13:33:11.561788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG passlib.handlers.bcrypt [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86852) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 13:33:11.616345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:11.617963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:11.739669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 13:33:11.912922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:11.983781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: INFO dbcounter [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] Registered counter for database keystone Jul 06 13:33:12.003661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG oslo_db.sqlalchemy.engines [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 13:33:12.009715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writer thread running {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 13:33:12.127779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7af3f-4dba-4ffe-9915-cb150cab5713 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:12.132042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:12.132709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:12.132998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:12.133278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:12.141283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:12.193180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING keystone.common.rbac_enforcer.enforcer [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 13:33:12.193471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64019bb8-d60a-4b51-97ec-6b0afe87f627 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:12.202849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Jul 6 13:33:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:33:12.209149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:12.224556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48db5ad-992e-4397-b9fc-e37e8e0ee546 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:12.228927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:12.230056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:12.230349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:12.230628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] PATH_INFO: `/v3/projects/3dbd2977ff724d4a80575343d59991ff` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:12.232127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] RBAC: Authorizing `identity:get_project(project_id=3dbd2977ff724d4a80575343d59991ff)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:12.285956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 13:33:12.286298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd25e1-b1f8-4d74-9587-6b42996cfbbb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:12.290866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Wed Jul 6 13:33:12 2022] GET /identity/v3/projects/3dbd2977ff724d4a80575343d59991ff => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:14.281710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13277f25-e4c4-4f62-9294-089d76186e60 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:14.282198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13277f25-e4c4-4f62-9294-089d76186e60 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:14.282198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13277f25-e4c4-4f62-9294-089d76186e60 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:14.286934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:14.292397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:14.292769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:14.292968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:14.311363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:14.312885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:14.321254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 06 13:33:14.344035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13277f25-e4c4-4f62-9294-089d76186e60 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:14.355948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13277f25-e4c4-4f62-9294-089d76186e60 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:14.360157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ae9ac-4a71-487c-a29e-733926278557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:14.360813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae9ac-4a71-487c-a29e-733926278557 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:14.361103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae9ac-4a71-487c-a29e-733926278557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:14.361381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ae9ac-4a71-487c-a29e-733926278557 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:14.368946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae9ac-4a71-487c-a29e-733926278557 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:14.370709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ae9ac-4a71-487c-a29e-733926278557 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:14.379916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Wed Jul 6 13:33:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:33:14.385015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:14.394437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592a4e-1d5d-44c8-bd28-17fdcda3d18a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:14.398788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a4ce5-9782-46d2-ac47-5d136964f45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:14.399675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4ce5-9782-46d2-ac47-5d136964f45f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:14.399963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4ce5-9782-46d2-ac47-5d136964f45f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:14.400241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4ce5-9782-46d2-ac47-5d136964f45f admin admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:14.401618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a4ce5-9782-46d2-ac47-5d136964f45f admin admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:14.403481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a4ce5-9782-46d2-ac47-5d136964f45f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:14.405035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Wed Jul 6 13:33:14 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:16.457893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a9105-34e1-462b-9e8d-d216cf89b3cb None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.458437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a9105-34e1-462b-9e8d-d216cf89b3cb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.458437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a9105-34e1-462b-9e8d-d216cf89b3cb None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.459833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:16.465346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.465758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.465905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.480412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1655d-2f07-4a44-9a9d-a5c47ae62670 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.480702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1655d-2f07-4a44-9a9d-a5c47ae62670 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.480982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1655d-2f07-4a44-9a9d-a5c47ae62670 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.482266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:16.482398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:16.483465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:16.487580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.487866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.488145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.527133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG passlib.handlers.bcrypt [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86853) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 13:33:16.527583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG passlib.handlers.bcrypt [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86853) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 13:33:16.565182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:16.573513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:16.575118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:16.587597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:16.612402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:16.676360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:16.694137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89914-93c9-4001-a0cd-1a51de241274 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:16.697774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:16.727892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:16.728619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.728903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.729181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.741085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:16.752326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:16.753268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:16.754077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:16.759529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:16.796307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204284f5-dcb0-4045-97d9-290cc5758185 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:16.799099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:16.834338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:16.835232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.835555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.835837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.843643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:16.863448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32aeee-334a-4469-8153-a97093ed6bc6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:16.897953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:16.898610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:16.898898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:16.899176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:16.899958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:16.900264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:16.901664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:16.902794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:16.904319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:16.914163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:16.919600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:16.999357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 13:33:17.004762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:17.007389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:17.017846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006f108-0be4-4c79-878f-f18e86baa941 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:17.050648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:17.051546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:17.051833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:17.052106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:17.053300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:17.054764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:17.056405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:16 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:17.061793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:17.075879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:17.100558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b7b1e-7559-44f4-965a-dfcd0f802270 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:17.134282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:17.135072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:17.135382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:17.135666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:17.154133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:17.155643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:17.161071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2ce62-7784-4cf7-8a5e-703beb5f87a4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:33:17.176200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:17.177162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:17.178123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:33:17.178123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:33:17.178123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:33:17.178123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:17.178123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:17.183416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:17.195573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:17.196371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:17.196657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:17.196935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:17.198108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:17.199577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:17.201359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:17.207447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:17.238243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:17.280852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad9c0ea-09b6-488f-a455-f54ce1745fee None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:17.286751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:17.305694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae688a-2f4d-4e39-a705-cc7ddf33c1a7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:17.314388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:17.315050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:17.315355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:17.315638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:17.316363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:17.316668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:17.318058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d9554-6a53-42b3-ae73-7ba22c6949a1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:17.335842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:17.338708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:17.339387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:17.339674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:17.339948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:17.340784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.domain.id=default, user.id=72199794cddc4ed1acf251b2e02a7bc7) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:17.341092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:17.342580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277516c-b9c5-4886-8fc2-388de730f160 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:17.350483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Jul 6 13:33:17 2022] GET /identity/v3/role_assignments?user.id=72199794cddc4ed1acf251b2e02a7bc7&scope.domain.id=default&role.id=729660ef64b242119ec8e65a05f1e171 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:19.740001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423095c-d7fc-4518-af8c-5980f91de49c None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:19.740510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423095c-d7fc-4518-af8c-5980f91de49c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:19.740581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423095c-d7fc-4518-af8c-5980f91de49c None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:19.741923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:19.747169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:19.747604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:19.747758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:19.769474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:19.770675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:19.793414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f11964-1966-4a8a-a378-47aaa8c43494 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:19.793701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f11964-1966-4a8a-a378-47aaa8c43494 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:19.793982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f11964-1966-4a8a-a378-47aaa8c43494 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:19.795363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:19.800334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e602-9b88-4669-95cd-3119fb4970a7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:19.800621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e602-9b88-4669-95cd-3119fb4970a7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:19.800902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f2e602-9b88-4669-95cd-3119fb4970a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:19.827432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d7f2e602-9b88-4669-95cd-3119fb4970a7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:19.828633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d7f2e602-9b88-4669-95cd-3119fb4970a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:19.914534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:19.950028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:19.981279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:20.006160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f161-b8d0-41e0-be98-15a058d7af76 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.006662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f161-b8d0-41e0-be98-15a058d7af76 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.007103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544f161-b8d0-41e0-be98-15a058d7af76 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.008624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:20.014673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f161-b8d0-41e0-be98-15a058d7af76 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:20.064294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:20.094694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:20.119055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29175e76-2b39-4b87-9ca2-d8af8f421179 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:20.159277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544f161-b8d0-41e0-be98-15a058d7af76 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:20.187849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada67968-3560-4709-ae33-6119dbfaec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:20.188684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67968-3560-4709-ae33-6119dbfaec64 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.189001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67968-3560-4709-ae33-6119dbfaec64 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.189286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada67968-3560-4709-ae33-6119dbfaec64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.212655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada67968-3560-4709-ae33-6119dbfaec64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-ada67968-3560-4709-ae33-6119dbfaec64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:20.224789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:20.225832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:20.226728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 13/27] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:20.228795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:20.229597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.229880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.230307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.231979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.238875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.239200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.248322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:20.250828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:20.273417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:20.274558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:33:20.287065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:20.288953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:20.290911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:33:20.290911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:33:20.290911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:33:20.290911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:20.290911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 15/28] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:20.295230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:20.419881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:20.421652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:20.422549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:20.424721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63d2f9-66e6-4441-a341-ff7d3b855ddc None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:20.463378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:20.464292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.464744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.465162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.466066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:20.466607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:20.468346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:20.481566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 16/30] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:20.482687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:20.562312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:20.592882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91565059-0c72-495a-a13a-85e649f51b9e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:20.627516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20983de-17e1-437e-adb2-4f83d9b169e9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:20.629735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083ef8c-8fa8-4c50-81a4-a961990333f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:20.630661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083ef8c-8fa8-4c50-81a4-a961990333f9 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.630965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083ef8c-8fa8-4c50-81a4-a961990333f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.631245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083ef8c-8fa8-4c50-81a4-a961990333f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.632048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083ef8c-8fa8-4c50-81a4-a961990333f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:20.633714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083ef8c-8fa8-4c50-81a4-a961990333f9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:20.670791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:20.671600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.672052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.672388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.673751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:20.674111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:20.675642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:20.695429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 15/31] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:20.696359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:20.765813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 17/32] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 13:33:20 2022] POST /identity/v3/roles => generated 219 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:20.768178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21d09-39c7-4567-8d07-7b1c326d0c57 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.768677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21d09-39c7-4567-8d07-7b1c326d0c57 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.769234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e21d09-39c7-4567-8d07-7b1c326d0c57 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.770838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 18/33] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:20.771843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e21d09-39c7-4567-8d07-7b1c326d0c57 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:20.810455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dadb1-d9c3-45a6-9768-6395893bce4a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:20.824017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:20.839188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:20.851676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d803e96-ab10-4301-8989-e50774b21bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:20.852605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d803e96-ab10-4301-8989-e50774b21bd1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.852884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d803e96-ab10-4301-8989-e50774b21bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.853409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d803e96-ab10-4301-8989-e50774b21bd1 None admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.854882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d803e96-ab10-4301-8989-e50774b21bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:20.856649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d803e96-ab10-4301-8989-e50774b21bd1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:20.858618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 16/34] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:20 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:20.860168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:20.861165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:20.861692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:20.880125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:20.881862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:20.962392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 17/35] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:20.963910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:21.015527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e21d09-39c7-4567-8d07-7b1c326d0c57 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.054267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106356a-1538-4eca-ad72-8e1ef50bcfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.054947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106356a-1538-4eca-ad72-8e1ef50bcfbe None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.055236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106356a-1538-4eca-ad72-8e1ef50bcfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.055548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106356a-1538-4eca-ad72-8e1ef50bcfbe None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.056521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106356a-1538-4eca-ad72-8e1ef50bcfbe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.058106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106356a-1538-4eca-ad72-8e1ef50bcfbe None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.089466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f49e5d-f348-4576-a82c-3bda6e5e8e3f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.094662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 19/36] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:33:20 2022] POST /identity/v3/projects => generated 301 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:21.096434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983be4-28f6-43af-8f49-dd3dacdb40cb None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.096719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983be4-28f6-43af-8f49-dd3dacdb40cb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.096996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1983be4-28f6-43af-8f49-dd3dacdb40cb None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.098573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 20/37] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:21.103622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1983be4-28f6-43af-8f49-dd3dacdb40cb None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:21.125648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:21.140632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8139f4a0-855b-4277-a995-de2f4810218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.141605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139f4a0-855b-4277-a995-de2f4810218e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.142296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139f4a0-855b-4277-a995-de2f4810218e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.142584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8139f4a0-855b-4277-a995-de2f4810218e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.144284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139f4a0-855b-4277-a995-de2f4810218e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.145810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8139f4a0-855b-4277-a995-de2f4810218e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.148775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 18/38] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:21.150226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.150518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.150792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.174014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:21.175976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:21.186481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:21.225323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1983be4-28f6-43af-8f49-dd3dacdb40cb None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.253996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 19/39] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:21.255096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:21.267105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd3bd5-d3d0-4372-b2c5-f146c4aa1e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.267825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd3bd5-d3d0-4372-b2c5-f146c4aa1e67 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.268113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd3bd5-d3d0-4372-b2c5-f146c4aa1e67 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.268395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd3bd5-d3d0-4372-b2c5-f146c4aa1e67 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.269144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd3bd5-d3d0-4372-b2c5-f146c4aa1e67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.270539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd3bd5-d3d0-4372-b2c5-f146c4aa1e67 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.287072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 13:33:21 2022] POST /identity/v3/roles => generated 225 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:21.288537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be409-a350-4f18-97cb-8f0fd12d606b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.288836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be409-a350-4f18-97cb-8f0fd12d606b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.289183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217be409-a350-4f18-97cb-8f0fd12d606b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.290444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 22/41] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:21.292019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217be409-a350-4f18-97cb-8f0fd12d606b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:21.386621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b02e2-cac8-4434-aebc-9778881311f4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.409747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:21.424333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217be409-a350-4f18-97cb-8f0fd12d606b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.425227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.426254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.426405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.426684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] PATH_INFO: `/v3/domains/default/users/72199794cddc4ed1acf251b2e02a7bc7/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.428929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=72199794cddc4ed1acf251b2e02a7bc7, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.430418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.457908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:21.463613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff80e3-7174-4c18-895b-69cc07577d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.465538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff80e3-7174-4c18-895b-69cc07577d64 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.465538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff80e3-7174-4c18-895b-69cc07577d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.465698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff80e3-7174-4c18-895b-69cc07577d64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.467921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff80e3-7174-4c18-895b-69cc07577d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.469279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff80e3-7174-4c18-895b-69cc07577d64 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.472054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 23/42] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:21.473216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.473584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.474227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.492570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:21.494181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:21.569787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 24/43] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:21.570818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:21.659837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 20/44] 10.222.0.25 () {58 vars in 1361 bytes} [Wed Jul 6 13:33:21 2022] PUT /identity/v3/domains/default/users/72199794cddc4ed1acf251b2e02a7bc7/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:21.660765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:21.779535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58075a-1780-4d73-b1d8-e837d64b8e41 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.796806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dacb22-2b90-4844-8364-52ec7391b2c5 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:21.828791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfff3e6-cafb-4247-adaf-c909a59f26ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.830036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff3e6-cafb-4247-adaf-c909a59f26ee None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.830327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff3e6-cafb-4247-adaf-c909a59f26ee None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.831183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfff3e6-cafb-4247-adaf-c909a59f26ee None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.831401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff3e6-cafb-4247-adaf-c909a59f26ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.833009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfff3e6-cafb-4247-adaf-c909a59f26ee None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.836526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:21.843006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6d19b-24c4-4e86-a959-c82b169cd8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:21.843733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d19b-24c4-4e86-a959-c82b169cd8b5 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:21.844029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d19b-24c4-4e86-a959-c82b169cd8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:21.844316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6d19b-24c4-4e86-a959-c82b169cd8b5 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:21.845089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d19b-24c4-4e86-a959-c82b169cd8b5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:21.846537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f6d19b-24c4-4e86-a959-c82b169cd8b5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:21.852271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 21/45] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 13:33:21 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:21.879399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:33:21 2022] POST /identity/v3/projects => generated 312 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:23.685913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab592dc-d709-440b-8c6d-6a00495220ee None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:23.686427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab592dc-d709-440b-8c6d-6a00495220ee None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:23.686530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab592dc-d709-440b-8c6d-6a00495220ee None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:23.687940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:23.693536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198474-1304-457f-92f8-195ec24abfbd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:23.693932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198474-1304-457f-92f8-195ec24abfbd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:23.694244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30198474-1304-457f-92f8-195ec24abfbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:23.710556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-30198474-1304-457f-92f8-195ec24abfbd None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:23.711785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-30198474-1304-457f-92f8-195ec24abfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:23.776105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:23.799332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab592dc-d709-440b-8c6d-6a00495220ee None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:23.842225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:23.903052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab592dc-d709-440b-8c6d-6a00495220ee None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:23.907098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad0f96-38d8-4bba-997d-a687a1a67a74 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:23.907457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad0f96-38d8-4bba-997d-a687a1a67a74 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:23.907746 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ad0f96-38d8-4bba-997d-a687a1a67a74 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:23.909121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 27/49] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:23.914376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:23.914670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:23.915108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:23.931976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:23.933163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:23.937752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:23.938489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:23.939376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:23.939665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:23.949754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:23.957432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:23.958451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:23.959168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 23/50] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:23.964785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:23.998021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 28/51] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:24.021037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:24.060031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:24.063071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26f548-7acb-4a59-8d6d-ced3e8ec5668 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:24.063252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:24.097913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:24.098584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:24.098871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:24.099156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:24.100014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:24.100329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:24.101736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:24.109737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 24/52] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:24.115916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:24.119631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5568c6-1e26-4436-89a6-467807caf86e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:24.152690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:24.153483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:24.153768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:24.154046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:24.155220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:24.156696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:24.158787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 29/53] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:24.164115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:24.210901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b163b-4dfd-4b2d-bfb1-d858daafd906 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:24.244404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:24.245268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:24.245556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:24.245838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:24.247041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:24.248539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:24.250167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 25/54] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:24 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:24.255478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:24.261020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fbec0-8127-4860-b2ce-7b033d5e83a2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:24.271991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:24.286538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:24.296927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:24.297585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:24.297895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:24.298697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:24.299473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:24.300913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:24.339584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 30/55] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Jul 6 13:33:24 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:33:24.361637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ea38e-04c1-42a4-8a0a-2c2d83df0547 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:24.398188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51733a-a9eb-4f83-8fac-9a76bb1fb013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:24.398993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51733a-a9eb-4f83-8fac-9a76bb1fb013 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:24.399276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51733a-a9eb-4f83-8fac-9a76bb1fb013 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:24.399580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51733a-a9eb-4f83-8fac-9a76bb1fb013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:24.400974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51733a-a9eb-4f83-8fac-9a76bb1fb013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:24.402457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51733a-a9eb-4f83-8fac-9a76bb1fb013 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:24.404181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 26/56] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:24.410883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:24.513946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be262e8-12bb-4d4b-8b19-41a21a0bb07e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:24.547935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:24.548600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:24.548889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:24.549170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:24.550010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.domain.id=default, user.id=72199794cddc4ed1acf251b2e02a7bc7) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:24.550325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:24.551802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f8b690-99de-4011-bc00-ef6986888c4f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:24.560331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 31/57] 10.222.0.25 () {56 vars in 1322 bytes} [Wed Jul 6 13:33:24 2022] GET /identity/v3/role_assignments?user.id=72199794cddc4ed1acf251b2e02a7bc7&scope.domain.id=default&role.id=729660ef64b242119ec8e65a05f1e171 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:26.335573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dda74-4030-41e3-9857-b953e921d00a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:26.336061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dda74-4030-41e3-9857-b953e921d00a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:26.336142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dda74-4030-41e3-9857-b953e921d00a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:26.337495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 27/58] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:26.342669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:26.343083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:26.343232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:26.360011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:26.361806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:26.380924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:26.426587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 32/59] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:26.449759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dda74-4030-41e3-9857-b953e921d00a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:26.543227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:26.548566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dda74-4030-41e3-9857-b953e921d00a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:26.579945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0237e7-4571-4a99-b0b2-2a9bb96bdf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:26.580720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0237e7-4571-4a99-b0b2-2a9bb96bdf11 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:26.581004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0237e7-4571-4a99-b0b2-2a9bb96bdf11 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:26.581281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0237e7-4571-4a99-b0b2-2a9bb96bdf11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:26.582433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0237e7-4571-4a99-b0b2-2a9bb96bdf11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:26.583965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0237e7-4571-4a99-b0b2-2a9bb96bdf11 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:26.585551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 28/60] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:26.591114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:26.685351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a05fec-4725-47f4-91b5-d321cdda30ce None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:26.717807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de735868-4321-41aa-9d2b-356cb8f0a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:26.718470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735868-4321-41aa-9d2b-356cb8f0a8d3 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:26.718756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735868-4321-41aa-9d2b-356cb8f0a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:26.719029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735868-4321-41aa-9d2b-356cb8f0a8d3 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:26.720334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de735868-4321-41aa-9d2b-356cb8f0a8d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:26.721779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de735868-4321-41aa-9d2b-356cb8f0a8d3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:26.746004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 33/61] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:26 2022] POST /identity/v3/users => generated 275 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:29.944395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88167803-4a8e-4163-a730-b7586f4c994d None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:29.944934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88167803-4a8e-4163-a730-b7586f4c994d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:29.944934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88167803-4a8e-4163-a730-b7586f4c994d None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:29.946343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 29/62] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:29.951670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3498d7-4332-4fba-b9c4-b04bf287d243 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:29.952060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3498d7-4332-4fba-b9c4-b04bf287d243 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:29.953569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3498d7-4332-4fba-b9c4-b04bf287d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:29.976517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ee3498d7-4332-4fba-b9c4-b04bf287d243 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:29.977963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ee3498d7-4332-4fba-b9c4-b04bf287d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:29.989252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.069737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 34/63] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:30.080790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7e36-9cd6-4492-bc9a-e921c88f05e1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.081437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7e36-9cd6-4492-bc9a-e921c88f05e1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.081926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca7e36-9cd6-4492-bc9a-e921c88f05e1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.083820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 30/64] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:30.088939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.089232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.089510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.099499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7e36-9cd6-4492-bc9a-e921c88f05e1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.114023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:30.115230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:30.239000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 35/65] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:30.264989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca7e36-9cd6-4492-bc9a-e921c88f05e1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.283374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.327424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65054e02-7171-4d0d-8ff8-54488574a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.327424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054e02-7171-4d0d-8ff8-54488574a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.327424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054e02-7171-4d0d-8ff8-54488574a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.327424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65054e02-7171-4d0d-8ff8-54488574a6e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.351330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65054e02-7171-4d0d-8ff8-54488574a6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-65054e02-7171-4d0d-8ff8-54488574a6e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:30.359216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:30.360278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:30.361809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:30.363835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 31/66] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:30.365288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902285-da06-4f75-a722-bc3d0ec35870 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.365742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902285-da06-4f75-a722-bc3d0ec35870 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.366177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902285-da06-4f75-a722-bc3d0ec35870 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.367627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 32/67] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:30.369716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb902285-da06-4f75-a722-bc3d0ec35870 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.394266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.404383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.432123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747f088-75f9-4d45-9e4b-498e8c70860a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.468566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56678dc-ee59-45fb-825e-16572b32eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.469380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56678dc-ee59-45fb-825e-16572b32eba6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.469722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56678dc-ee59-45fb-825e-16572b32eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.470577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56678dc-ee59-45fb-825e-16572b32eba6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.482683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56678dc-ee59-45fb-825e-16572b32eba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a56678dc-ee59-45fb-825e-16572b32eba6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:30.491870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:30.492701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:30.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 36/68] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:30.494679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.494679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.494971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.503135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb902285-da06-4f75-a722-bc3d0ec35870 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.511830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:30.513049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:30.540389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.541158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.541662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.541765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.542469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:30.542784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:30.544219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999071cf-3e6a-4eed-ad29-b4dd9e38ddf5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:30.553331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 33/69] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:30.554565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdf9f-f723-4f80-a488-3e37c36fdfe1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.554949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdf9f-f723-4f80-a488-3e37c36fdfe1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.555237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccdf9f-f723-4f80-a488-3e37c36fdfe1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.559591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 34/70] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:30.559591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdf9f-f723-4f80-a488-3e37c36fdfe1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.591419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 37/71] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:30.591419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.650239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.652275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.665816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccdf9f-f723-4f80-a488-3e37c36fdfe1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.690276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b4d59-299a-432d-ab8e-324e8587e0e2 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.700108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.700778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.701079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.701364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.702116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:30.702431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:30.703877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60558169-8d76-4198-9a27-8182faadee3f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:30.712168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 35/72] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:30.713684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.713982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.714271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.724594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb3320-4d0a-40ea-b9bc-5d8d55adcf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.725475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3320-4d0a-40ea-b9bc-5d8d55adcf6b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.725765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3320-4d0a-40ea-b9bc-5d8d55adcf6b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.726045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb3320-4d0a-40ea-b9bc-5d8d55adcf6b None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.730340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:30.731885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:30.741586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb3320-4d0a-40ea-b9bc-5d8d55adcf6b None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:30.743048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb3320-4d0a-40ea-b9bc-5d8d55adcf6b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:30.744765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 38/73] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:30.745974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1c60-7d06-4fe3-92ec-98fe34b2c738 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.746262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1c60-7d06-4fe3-92ec-98fe34b2c738 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.746540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1c60-7d06-4fe3-92ec-98fe34b2c738 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.747802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 39/74] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:30.748498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1c60-7d06-4fe3-92ec-98fe34b2c738 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.806729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 36/75] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:30.807586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.857097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1c60-7d06-4fe3-92ec-98fe34b2c738 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.877878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.886954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:30.892481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.893284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.893571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.893848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.895034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:30.896573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:30.898200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 40/76] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:30.898974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:30.907728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b047013-7059-445c-9b15-8795bb9ee648 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:30.941154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18fe79-7bf5-49d2-ac2c-e96580e0dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:30.942026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18fe79-7bf5-49d2-ac2c-e96580e0dc08 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.942317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18fe79-7bf5-49d2-ac2c-e96580e0dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.942595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18fe79-7bf5-49d2-ac2c-e96580e0dc08 None admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.943820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18fe79-7bf5-49d2-ac2c-e96580e0dc08 None admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:30.945282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18fe79-7bf5-49d2-ac2c-e96580e0dc08 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:30.946908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 37/77] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:30.951693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:30.951693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:30.951693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:30.964392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:30.965575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:30.997845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fc539-42a7-43c2-8bc5-937631716f7d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.030278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 38/78] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:31.031284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.035738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.036408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.036722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.037002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.093836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.106605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.108158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.108831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.130416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e46a9b-15e5-4e21-a54f-3939a2585867 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.163940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.164744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.165033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.165304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.175565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:31.183780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:31.184636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:31.185408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 39/79] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:31.186023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.209246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 41/80] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:31.210108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.287521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65545d87-b26c-4846-9cd1-a588e51a7cd2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.296259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.308793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c084c4-15a7-4dcd-aab4-15f5adbadc16 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.319793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.320466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.320756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.321039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.321784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.323256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.336626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.342374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.343227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.343520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.343806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.350547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 40/81] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:31 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:31.351383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.419732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.421154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.483735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b972dd-2bb4-428c-ac9a-5ceec95ad2a9 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.519856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.532021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.533375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.533660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.533944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.539464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 42/82] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:31.540496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.544718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:31.552421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:31.553379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:31.554227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 41/83] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:31.554985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.631983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.663196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf080-afee-4bba-8b34-7f10b07db832 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.690215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f6026-8880-4f29-b2c2-209dddb62d85 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.711505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.712719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.713315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.713598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.714655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:31.714992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.717347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.726848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.727757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.728043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.728323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.728424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 43/84] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:31.729162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.732094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.738083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.738083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 42/85] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:31.738083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.793974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.862311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf0e27-3dc0-47a9-829b-e8108feeb8e4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.864211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a539343-6980-4d76-953b-2407c4f81611 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:31.893655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:31.901050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.902191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.902677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.903117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.904516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.906179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.906530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:31.907232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:31.907559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:31.907840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:31.908590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:31.908900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:31.913541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 44/86] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:31.913692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:31.914803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:31.920341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 43/87] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:31.921467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.036870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf05be-f566-4cdc-9a17-7f0e125b0462 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:32.037372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb34e8a-b350-4c94-804e-7c258123371f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:32.057514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:32.074906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:32.075660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:32.075951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:32.076235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:32.077113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=3243d044257f4a73b3712a5d22235385) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:32.077436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:32.078948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:32.079874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:32.080914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:32.081496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:32.081910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:32.083934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:32.085057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/role_assignments?user.id=3243d044257f4a73b3712a5d22235385&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:32.085754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:32.085933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.087784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 45/89] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:31 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:32.089211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.185480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:32.271979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a837-5c5f-470e-a84b-60fd5a709b27 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:32.298753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d742bd-c708-45fd-b275-401685a96588 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:32.317789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:32.317789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:32.318044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:32.318211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:32.319243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=72199794cddc4ed1acf251b2e02a7bc7) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:32.319612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:32.321548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:32.328982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 45/90] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:32 2022] GET /identity/v3/role_assignments?user.id=72199794cddc4ed1acf251b2e02a7bc7&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:32.330570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.342815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:32.344182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:32.344723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:32.345532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:32.347263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:32.349805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:32.352048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 46/91] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:32 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:32.357707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.450061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:32.530548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4107ae-3f59-44e9-a3e8-138252dc7d10 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:32.547086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e56add-d581-4167-9c66-5edafe029ca9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:32.561315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:32.608710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:32.609030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:32.609386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:32.609651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:32.609749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:32.609949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:32.610043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:32.610275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:32.717657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:32.719179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:32.760924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:32.762421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:32.823499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:32.891155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 47/92] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:32.901115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.955988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 46/93] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:32.965107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:32.984831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:33.087426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3dd4d-cbeb-4a8c-9299-5f3e531bb52a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:33.145563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1135c7-3787-4be9-89c0-20b8bbc89b66 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:33.148276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:33.149146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:33.149429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:33.149764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] PATH_INFO: `/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:33.151099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] RBAC: Authorizing `identity:get_project(project_id=62113832ab664b2bb7e3e0d5cd1cb899)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:33.152590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:33.154454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 48/94] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:32 2022] GET /identity/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:33.165240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:33.206831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:33.222280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:33.223150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:33.223453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:33.223732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:33.225580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:33.227027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:33.228771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 47/95] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:32 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:33.234758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:33.346614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b3480-74a4-4a28-99dc-6624217df50b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:33.411761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:33.421772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:33.422435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:33.422742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:33.423023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:33.423901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=62113832ab664b2bb7e3e0d5cd1cb899, user.id=3243d044257f4a73b3712a5d22235385) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:33.424214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:33.425666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43b1cf-4172-43f3-8b31-6d225ffc15ff None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:33.436824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 49/96] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:33 2022] GET /identity/v3/role_assignments?user.id=3243d044257f4a73b3712a5d22235385&scope.project.id=62113832ab664b2bb7e3e0d5cd1cb899&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 259 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:33.443686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d271d-6935-457d-ac03-2854d92dc94b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:33.494317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:33.494981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:33.495269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:33.495572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:33.496418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] RBAC: Adding query filter params (role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=3243d044257f4a73b3712a5d22235385) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:33.496735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:33.498254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb37c35-eb61-441c-8274-9fbf0544f1b1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:33.507972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 48/97] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:33 2022] GET /identity/v3/role_assignments?user.id=3243d044257f4a73b3712a5d22235385&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=be9562507bd540289a07df4afd1c4cee => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:34.074279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011601-7448-41df-8201-b9f24ee1c4fc None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.074630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011601-7448-41df-8201-b9f24ee1c4fc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.074802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011601-7448-41df-8201-b9f24ee1c4fc None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.076180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 50/98] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:34.081958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c66785-dedc-4356-bf71-2e5a15c750d4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.082252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c66785-dedc-4356-bf71-2e5a15c750d4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.082535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c66785-dedc-4356-bf71-2e5a15c750d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.116452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-60c66785-dedc-4356-bf71-2e5a15c750d4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:34.117644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-60c66785-dedc-4356-bf71-2e5a15c750d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:34.209015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 49/99] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:34.231884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011601-7448-41df-8201-b9f24ee1c4fc None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:34.245533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552a11-0a3c-4cf7-9dd5-6320661c7bb9 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.245830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552a11-0a3c-4cf7-9dd5-6320661c7bb9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.246117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69552a11-0a3c-4cf7-9dd5-6320661c7bb9 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.248766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 50/100] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:34.262331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.262621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.262906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.282296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:34.283685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:34.366779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 51/101] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:34.407452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:34.415673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:34.417643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:34.460000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011601-7448-41df-8201-b9f24ee1c4fc None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:34.560550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:34.561366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.561654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.561932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.568157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:34.569638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:34.571524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 51/102] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:34.580624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:34.597288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590615ad-6a7f-465b-b8d5-ef7744305ef0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:34.667926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:34.668670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.668961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.669246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.692976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:34.709487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:34.710352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:34.711080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 52/103] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:34.719097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:34.771878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff451f9-0ff3-4f82-a4c5-0c860f977d42 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:34.846469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:34.847569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:34.855072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.855072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.855072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.855072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:34.855072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:34.895714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b86eb-e00d-423d-9f9c-4c9b8f1f3c1d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:34.906616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 52/104] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:33:34 2022] POST /identity/v3/projects => generated 302 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:33:34.962439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:34.963347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:34.963648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:34.963928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:34.964695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:34.965005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:34.966476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef8713e-1538-45b5-a7e2-1e5ee9edcd93 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:34.979054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 53/105] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:34.984567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:34.995592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:35.018659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040855-5cb7-4484-b70a-92272b57eb4a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.018973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040855-5cb7-4484-b70a-92272b57eb4a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.019224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd040855-5cb7-4484-b70a-92272b57eb4a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.020993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 54/106] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:35.028932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.029221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.029499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.068449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:35.069935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:35.148758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142525f-8c2c-4864-9521-9a7939568f28 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:35.186490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:35.187654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.188082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.188559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] PATH_INFO: `/v3/users/9ff6625fc4574070a27f0a03fd61f03c` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.204821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] RBAC: Authorizing `identity:get_user(user_id=9ff6625fc4574070a27f0a03fd61f03c)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:35.206845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:35.209012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 53/107] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:34 2022] GET /identity/v3/users/9ff6625fc4574070a27f0a03fd61f03c => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:35.216678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:35.307729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:35.316695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 55/108] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:35.330714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2df47c-1321-4b02-abdd-c4cf09cd7a38 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:35.357044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:35.370866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e747ef0-bf52-4cc7-9569-8ac8420cb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:35.371776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e747ef0-bf52-4cc7-9569-8ac8420cb350 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.372201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e747ef0-bf52-4cc7-9569-8ac8420cb350 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.372646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e747ef0-bf52-4cc7-9569-8ac8420cb350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.460564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e747ef0-bf52-4cc7-9569-8ac8420cb350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:35.462332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e747ef0-bf52-4cc7-9569-8ac8420cb350 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:35.512799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:35.586859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91f2e1-ac7f-4480-a71e-96a7de582bb6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:35.609902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:35.625581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0079367-e27c-46f4-8db1-be0a94676ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:35.626647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079367-e27c-46f4-8db1-be0a94676ff4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.627104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079367-e27c-46f4-8db1-be0a94676ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.627549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0079367-e27c-46f4-8db1-be0a94676ff4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.639701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0079367-e27c-46f4-8db1-be0a94676ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-a0079367-e27c-46f4-8db1-be0a94676ff4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:35.648544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:35.649564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:35.650477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:35.652453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 56/109] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:35.653917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a177-4b48-4b55-bf32-067d0232d04c None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.654943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a177-4b48-4b55-bf32-067d0232d04c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.655454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13a177-4b48-4b55-bf32-067d0232d04c None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.659132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 57/110] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:35.660367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a177-4b48-4b55-bf32-067d0232d04c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:35.718528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 13:33:35.720496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.720793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.721076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.760345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:35.761555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:35.772779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13a177-4b48-4b55-bf32-067d0232d04c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:35.791426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:35.814302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:35.815239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:35.815739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:35.816037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:35.816822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:35.817135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:35.818527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:35.840077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 58/112] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:35.840786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:35.912732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:35.913867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:35.981720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef2e47-4131-4432-ac83-60351c7078c6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.026048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.026839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.027126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.027426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.034902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.036408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.038314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 59/114] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:35 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:36.038927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.121391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:36.131764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2fdc7-24ae-4308-acca-7e702086be56 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.142582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:36.209465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.210361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.210650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.210935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.212217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.214391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.216304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 56/115] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:35 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:36.217494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.257652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161453b-102d-4a02-b7c4-85e6affcfca8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.308662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.309908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.310445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.311356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.324827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:36.336481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:36.337312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:36.338389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:36.338950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f486a5-ca87-4fe8-8caf-fa91f747bb62 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.342351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:36.343405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.380341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.381003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.381448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.381987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.383537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] RBAC: Adding query filter params (role.id=96f249ee1b1948f580706967e5a94ee1, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=9ff6625fc4574070a27f0a03fd61f03c) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:36.383996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.386813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8db3d-2590-4c54-9ff6-15ac20a78fdb None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.393863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 57/117] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/role_assignments?user.id=9ff6625fc4574070a27f0a03fd61f03c&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=96f249ee1b1948f580706967e5a94ee1 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:36.395837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bdf06-3ad4-4188-870c-212da132119b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.396264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bdf06-3ad4-4188-870c-212da132119b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.396669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77bdf06-3ad4-4188-870c-212da132119b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.398724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 58/118] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:36.399814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bdf06-3ad4-4188-870c-212da132119b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.431424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:36.481763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f6431-6312-4956-83f8-cce325598af2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.492511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:36.530296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2ebc1-5a46-4dfe-9afc-999520833e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.531597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ebc1-5a46-4dfe-9afc-999520833e26 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.531781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77bdf06-3ad4-4188-870c-212da132119b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.532109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ebc1-5a46-4dfe-9afc-999520833e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.532880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2ebc1-5a46-4dfe-9afc-999520833e26 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.534165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ebc1-5a46-4dfe-9afc-999520833e26 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.537214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2ebc1-5a46-4dfe-9afc-999520833e26 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.539042 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 61/119] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:36.540382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1c44-8d26-4f5d-b594-ed253a407d11 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.540673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1c44-8d26-4f5d-b594-ed253a407d11 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.540951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb1c44-8d26-4f5d-b594-ed253a407d11 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.542239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 62/120] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:36.544125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7dc8-9805-4ced-8c0d-addf3b20d811 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.544430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7dc8-9805-4ced-8c0d-addf3b20d811 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.544712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f7dc8-9805-4ced-8c0d-addf3b20d811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.566274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ae8f7dc8-9805-4ced-8c0d-addf3b20d811 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:36.567877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ae8f7dc8-9805-4ced-8c0d-addf3b20d811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:36.581903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.582585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.582872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.583151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.584041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:36.584355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.585830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.599172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 59/121] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:36.600320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.647998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 63/122] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:36.649527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.649958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.650374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.666989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:36.668406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:36.697448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:36.712979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a904a30-805c-4975-aa65-748567983bf1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.736837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:36.737790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.750692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.752288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.752835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.753341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/3243d044257f4a73b3712a5d22235385/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.756107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] RBAC: Authorizing `identity:create_grant(project_id=8a9625e843ca4297a7b9b2cd63ffa98f, user_id=3243d044257f4a73b3712a5d22235385, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.757913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.772069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:36.777875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 60/124] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:36 2022] PUT /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/3243d044257f4a73b3712a5d22235385/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:36.779092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.888077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1f3fc-2656-4419-896f-c75ed785b17c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.915361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9b34a-69af-4a03-b2ce-262c06ee5e0d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:36.954922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.955787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.956074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.956352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.958498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:36.959418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:36.959763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:36.960044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:36.961489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:36.962985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:36.975783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 65/125] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:36.977083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:36.987030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:37.003530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:37.004432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:37.005168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:37.008144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 61/126] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:37.009131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.029816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:37.119156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479f206-307c-4c91-8397-018c58af3a7c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.121190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:37.135701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bb45f-c8f9-467b-87e0-3685188009af None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.173992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.174719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.175006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.175284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.182591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.191497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.191785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.192070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.195702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.197187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.198929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 62/127] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:37.199734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.204359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:37.212085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:37.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:37.213922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:37.217358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 66/128] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:37.222034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.317152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:37.343213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21a4aa-93a4-411b-82db-1b64d7932bd7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.379947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.380623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.380955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.381173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.382094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:37.382502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.384005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.392609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 63/129] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:37.393490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.410944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e67e6-c75e-4025-9854-8cd4a66e1c61 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.456345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.457169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.457460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.457744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/72199794cddc4ed1acf251b2e02a7bc7/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.459763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a9625e843ca4297a7b9b2cd63ffa98f, user_id=72199794cddc4ed1acf251b2e02a7bc7, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.461241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.487971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:37 2022] PUT /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/72199794cddc4ed1acf251b2e02a7bc7/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:37.489259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.521543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:37.535001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72006171-b401-4d92-9641-7e34ffa7d130 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.606709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.607419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.608129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.608415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.609477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] RBAC: Adding query filter params (name=member) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:37.609789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.612540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.630633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:37.644552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 64/131] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:37.656538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.676091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3dfc9-979e-43e6-8309-645ff7dfd732 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.730495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.735868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.736263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.736557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.737923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.739545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.741430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 68/132] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:37.746954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.822177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a25ae0-bd22-4047-b0d8-56a96cc69692 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.847679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:37.859460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926ccf4-c881-4708-af15-7d186a46011b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:37.876992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.877897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.878188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.878470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.884092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.885584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.887442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 65/133] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:37.893301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.896463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:37.897331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:37.897617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:37.897899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:37.899087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:37.900704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:37.902528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 69/134] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:37.908538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:37.972217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:38.006434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ef4b6-0841-4c05-b061-41621213e7b9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:38.018915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c8201-5588-4066-b220-4898f8da3a55 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:38.041895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c16e0-7239-47b6-8a09-eca45ef4b953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:38.042764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c16e0-7239-47b6-8a09-eca45ef4b953 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.043049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c16e0-7239-47b6-8a09-eca45ef4b953 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.043341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c16e0-7239-47b6-8a09-eca45ef4b953 None admin] PATH_INFO: `/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.044558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c16e0-7239-47b6-8a09-eca45ef4b953 None admin] RBAC: Authorizing `identity:get_project(project_id=62113832ab664b2bb7e3e0d5cd1cb899)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:38.046014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1c16e0-7239-47b6-8a09-eca45ef4b953 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:38.048094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 66/135] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:37 2022] GET /identity/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:38.049358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcffc29-d762-42b0-8734-e9290c3c6427 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.049650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcffc29-d762-42b0-8734-e9290c3c6427 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.049936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcffc29-d762-42b0-8734-e9290c3c6427 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.051290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 67/136] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:38.055658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcffc29-d762-42b0-8734-e9290c3c6427 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:38.056128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fbd70-7a98-4b7f-8f8d-8fccddea2e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:38.057220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fbd70-7a98-4b7f-8f8d-8fccddea2e93 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.057513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fbd70-7a98-4b7f-8f8d-8fccddea2e93 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.057795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fbd70-7a98-4b7f-8f8d-8fccddea2e93 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/3243d044257f4a73b3712a5d22235385/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.060210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fbd70-7a98-4b7f-8f8d-8fccddea2e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a9625e843ca4297a7b9b2cd63ffa98f, user_id=3243d044257f4a73b3712a5d22235385, role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:38.061677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fbd70-7a98-4b7f-8f8d-8fccddea2e93 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:38.089157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 70/137] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:37 2022] PUT /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/3243d044257f4a73b3712a5d22235385/roles/be9562507bd540289a07df4afd1c4cee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:33:38.090657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.091054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.091444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.117375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:38.118664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:38.143461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:38.182437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcffc29-d762-42b0-8734-e9290c3c6427 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:38.256206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:38.257184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.257421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.257704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] PATH_INFO: `/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899/users/3243d044257f4a73b3712a5d22235385/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.262961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:38.263295 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=62113832ab664b2bb7e3e0d5cd1cb899, user_id=3243d044257f4a73b3712a5d22235385, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:38.264816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:38.274380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:38.296023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:38 2022] PUT /identity/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899/users/3243d044257f4a73b3712a5d22235385/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:38.306027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:38.432806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7ca9e-a197-441d-b50e-b9863bde377f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:38.474944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e021d-de1a-4045-8348-8fb33d776a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:38.475967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e021d-de1a-4045-8348-8fb33d776a85 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.476251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e021d-de1a-4045-8348-8fb33d776a85 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.476667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e021d-de1a-4045-8348-8fb33d776a85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.478032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e021d-de1a-4045-8348-8fb33d776a85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:38.479671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e021d-de1a-4045-8348-8fb33d776a85 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:38.481810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 72/140] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:38.487250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:38.615626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45495643-29db-4bc6-906b-3f9667c048c8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:38.654760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6f782-a196-4bb3-b89e-a170027d8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:38.655470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f782-a196-4bb3-b89e-a170027d8596 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:38.655757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f782-a196-4bb3-b89e-a170027d8596 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:38.656035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6f782-a196-4bb3-b89e-a170027d8596 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:38.656776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6f782-a196-4bb3-b89e-a170027d8596 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:38.658312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6f782-a196-4bb3-b89e-a170027d8596 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:38.692435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 69/141] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:38 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:33:39.041428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810329b9-6a46-45cb-ab43-03b44e5e2716 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:39.042077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810329b9-6a46-45cb-ab43-03b44e5e2716 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:39.042578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810329b9-6a46-45cb-ab43-03b44e5e2716 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:39.044187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 73/142] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:39.050187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:39.050752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:39.051230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:39.071151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:39.072646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:39.129955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:39.154189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 70/143] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:39.198319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810329b9-6a46-45cb-ab43-03b44e5e2716 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:39.221180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:39.324553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810329b9-6a46-45cb-ab43-03b44e5e2716 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:39.370926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:39.372021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:39.372465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:39.372899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:39.388119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:39.396745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:39.397790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:39.398778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:39.400826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 74/144] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:39.406580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:39.549397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15876a2b-cbd8-4641-9b69-548761759e02 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:39.590407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:39.591031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:39.591345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:39.591633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:39.592403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] RBAC: Adding query filter params (name=reader) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:39.592721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:39.594127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:39.604401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 71/145] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:39.610225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:39.711353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:39.740775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c514-d34d-42b1-b8fa-df84a6f7b185 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:39.782782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:39.783682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:39.783973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:39.784251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] PATH_INFO: `/v3/users/9ff6625fc4574070a27f0a03fd61f03c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:39.785493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=9ff6625fc4574070a27f0a03fd61f03c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:39.786975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:39.788987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 75/146] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:39 2022] GET /identity/v3/users/9ff6625fc4574070a27f0a03fd61f03c => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:39.795643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:39.864377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:39.931766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53bc9-e491-4ca0-939d-a5cb59c85daa None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:39.978014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4827fbd-543e-449d-89f7-b8e4fac73d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:39.979310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4827fbd-543e-449d-89f7-b8e4fac73d60 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:39.979838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4827fbd-543e-449d-89f7-b8e4fac73d60 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:39.980361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4827fbd-543e-449d-89f7-b8e4fac73d60 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:39.981767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4827fbd-543e-449d-89f7-b8e4fac73d60 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:39.983466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4827fbd-543e-449d-89f7-b8e4fac73d60 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:39.985432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 72/147] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:39 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:39.991020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:40.043753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3bea0-d3d1-4013-bde4-72121a1b3fc0 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:40.044443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3bea0-d3d1-4013-bde4-72121a1b3fc0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:40.045190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3bea0-d3d1-4013-bde4-72121a1b3fc0 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:40.047806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 73/148] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:40.053688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:40.054273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:40.055173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:40.088040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:40.090825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:40.154285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388d908-d241-47cb-a0ae-a340d1239ed4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:40.216106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:40.217016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:40.217306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:40.217415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 74/149] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:40.217623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/9ff6625fc4574070a27f0a03fd61f03c/roles/96f249ee1b1948f580706967e5a94ee1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:40.219845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] RBAC: Authorizing `identity:create_grant(project_id=8a9625e843ca4297a7b9b2cd63ffa98f, user_id=9ff6625fc4574070a27f0a03fd61f03c, role_id=96f249ee1b1948f580706967e5a94ee1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:40.221319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:40.246588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 76/150] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:39 2022] PUT /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/users/9ff6625fc4574070a27f0a03fd61f03c/roles/96f249ee1b1948f580706967e5a94ee1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:40.266948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:40.317914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:40.393211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa230e2-5c1e-4d64-80b1-9ddef1177e60 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:40.443496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:40.443496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:40.443496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:40.443496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:40.461446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:40.471800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:40.472693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:40.473447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:40.475874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 75/151] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:40.483276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:40.492892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:40.611567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdac8f1-5fb2-4174-a36b-1fef1d6d34dd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:40.650984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:40.651690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:40.651979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:40.652261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:40.653023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:40.653331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:40.654725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:40.667245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:40.673490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:40.813834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32b217-b85e-4d70-bb4c-e6205b0f3055 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:40.815364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:40.857562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62b3c-9ddf-4f26-8d3a-6e03e999d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:40.858450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62b3c-9ddf-4f26-8d3a-6e03e999d45d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:40.858736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62b3c-9ddf-4f26-8d3a-6e03e999d45d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:40.859017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62b3c-9ddf-4f26-8d3a-6e03e999d45d None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:40.860837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62b3c-9ddf-4f26-8d3a-6e03e999d45d None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:40.862316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62b3c-9ddf-4f26-8d3a-6e03e999d45d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:40.863998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 76/153] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:40 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:40.869739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:40.974489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:41.011094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207f43-347c-4655-9ebc-8925d647c429 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:41.046293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:41.046955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.047239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.047577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.096031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b382-9130-41dc-8e85-0ddec8b44906 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.096315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b382-9130-41dc-8e85-0ddec8b44906 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.096518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b382-9130-41dc-8e85-0ddec8b44906 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.097897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 77/154] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:41.112638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.115686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.115997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.140563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:41.142302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:41.147131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:41.149480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:41.288876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 78/155] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:41.289089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:41.324016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:41.341356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 78/156] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:41.347026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:41.535063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757840c-7764-4afe-a5ce-e560977faa58 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:41.538215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2016f1-d26f-478b-ace4-7ac62d878200 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:41.564023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:41.598908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:41.599657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.599942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.600219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.605003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:41.605871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.606154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.606427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.609691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:41.611197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:41.612958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 79/157] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:41 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:41.619460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:41.628471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:41.643538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:41.644551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:41.645316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 79/158] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:41.652930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:41.686310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:41.834329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebff36-18bc-46b1-97a8-fe9d1fe20129 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:41.842929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36174cb-4d74-4ce2-9625-da5abaa76ad7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:41.896164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:41.897904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.899012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.899665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.901567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:41.902267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:41.904525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be04582-5f77-4081-ab78-7570ccdbf92c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:41.911643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:41.915203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.915741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.916220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.917257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=3243d044257f4a73b3712a5d22235385) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:41.917989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:41.920620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:41.925634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 80/159] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:41.927158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1cee-0a74-4298-bdd4-0bb8d3cfb68e None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.927922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1cee-0a74-4298-bdd4-0bb8d3cfb68e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.929290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f1cee-0a74-4298-bdd4-0bb8d3cfb68e None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.930759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 81/160] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:41.932363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061f1d-bf4a-4b5c-9ca4-3b9ea99bcb4b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.933722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061f1d-bf4a-4b5c-9ca4-3b9ea99bcb4b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.934367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0061f1d-bf4a-4b5c-9ca4-3b9ea99bcb4b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.937903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 82/161] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:41.938900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 80/162] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:41 2022] GET /identity/v3/role_assignments?user.id=3243d044257f4a73b3712a5d22235385&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:41.944059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:41.948711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af49b-bc76-4785-a0b6-c6e5024ee89b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:41.949384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af49b-bc76-4785-a0b6-c6e5024ee89b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:41.949864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6af49b-bc76-4785-a0b6-c6e5024ee89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:41.977477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8b6af49b-bc76-4785-a0b6-c6e5024ee89b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:41.979035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8b6af49b-bc76-4785-a0b6-c6e5024ee89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:41.998342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:42.091267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 83/163] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:42.093109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:42.095116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:42.096576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:42.130087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:42.132477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:42.136982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:42.143509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5236fe-1f24-46e7-ba62-8f8a32a378a8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:42.209998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:42.211439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:42.216747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:42.217238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] PATH_INFO: `/v3/users/72199794cddc4ed1acf251b2e02a7bc7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:42.218672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] RBAC: Authorizing `identity:get_user(user_id=72199794cddc4ed1acf251b2e02a7bc7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:42.220900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:42.222974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 81/164] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:41 2022] GET /identity/v3/users/72199794cddc4ed1acf251b2e02a7bc7 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:42.226000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:42.254077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 84/165] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:42.255261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:42.399917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:42.435624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6de02-800d-4d21-937c-6eec7255c5fb None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:42.437770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760515ae-3575-4949-bcb8-c384d47ee6c7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:42.500247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:42.501023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:42.501308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:42.501586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:42.502694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:42.503359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:42.503650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:42.503925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:42.532710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:42.546701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:42.547677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:42.548685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:42.549270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 82/166] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:33:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:42.549829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:42.615236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:42.621701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:42.623211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:42.776535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d96dc-e5ef-4e93-bc9e-ff90e8ae25e4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:42.792869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:42.836594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 85/167] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:42.837465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:42.861678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:42.862484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:42.862768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:42.863046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:42.892848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:42.901160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:42.902028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:42.902790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 83/168] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:42.908669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.064259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:43.095912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e177-9f20-4217-be8d-80f7993593a1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.104049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161f851-e050-4368-8ff7-4f0c83e78589 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.144729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.145600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.145887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.146165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.147380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.149156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:43.150869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 84/169] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:42 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:43.151751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.220066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.220752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.221038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.221317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.222083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:43.222390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.223820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:43.238048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 86/170] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:33:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:43.238893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.260817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a9d3e-a506-4189-9c60-79e4bb94f3cc None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.295982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.296658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.296949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.297233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.298529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:43.298846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.300388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:43.309533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 85/171] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:43.310456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.321496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:43.339682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:43.418791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886ebe1e-fec0-413c-973d-86b2c1a3e6fe None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.461155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6944325-3e84-4090-8afe-fe199cea9476 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.494356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.495524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.496120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.496602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.497707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=72199794cddc4ed1acf251b2e02a7bc7) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:43.498231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.500122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:43.508900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 87/172] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:43 2022] GET /identity/v3/role_assignments?user.id=72199794cddc4ed1acf251b2e02a7bc7&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:43.512487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.513498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dadd51-4548-42a5-8d9f-5044cb0b37c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.514405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dadd51-4548-42a5-8d9f-5044cb0b37c1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.514690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dadd51-4548-42a5-8d9f-5044cb0b37c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.514965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dadd51-4548-42a5-8d9f-5044cb0b37c1 None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.516741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dadd51-4548-42a5-8d9f-5044cb0b37c1 None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.519463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dadd51-4548-42a5-8d9f-5044cb0b37c1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:43.521384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 86/173] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:43 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:43.524596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab0503-013a-4415-aaad-261af37ad360 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.524884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab0503-013a-4415-aaad-261af37ad360 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.525161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab0503-013a-4415-aaad-261af37ad360 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.530738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 87/174] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:43.531640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab0503-013a-4415-aaad-261af37ad360 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.687597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5ce03-fd6c-452e-afc1-42d4fab7fda3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.709599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:43.736028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:43.751614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcf7d3-eea2-48cd-b6b0-44622604ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.752515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf7d3-eea2-48cd-b6b0-44622604ae40 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.752803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf7d3-eea2-48cd-b6b0-44622604ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.753082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcf7d3-eea2-48cd-b6b0-44622604ae40 None admin] PATH_INFO: `/v3/users/3243d044257f4a73b3712a5d22235385` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.756995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcf7d3-eea2-48cd-b6b0-44622604ae40 None admin] RBAC: Authorizing `identity:get_user(user_id=3243d044257f4a73b3712a5d22235385)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.758497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcf7d3-eea2-48cd-b6b0-44622604ae40 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:43.761323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 88/175] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:43 2022] GET /identity/v3/users/3243d044257f4a73b3712a5d22235385 => generated 275 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:43.764577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09c24-4d06-4541-9c42-754a311b17cf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.764866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09c24-4d06-4541-9c42-754a311b17cf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.765150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c09c24-4d06-4541-9c42-754a311b17cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.771888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab0503-013a-4415-aaad-261af37ad360 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:43.795699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-48c09c24-4d06-4541-9c42-754a311b17cf None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:43.797041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-48c09c24-4d06-4541-9c42-754a311b17cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:43.828476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550462c-e12f-414e-b5d4-cf60329f785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:43.829188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550462c-e12f-414e-b5d4-cf60329f785e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.829571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550462c-e12f-414e-b5d4-cf60329f785e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.829853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550462c-e12f-414e-b5d4-cf60329f785e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.896533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 89/176] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:43.898060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62861-8273-4dbf-9218-71f073ed5dff None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:43.898356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62861-8273-4dbf-9218-71f073ed5dff None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:43.898634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b62861-8273-4dbf-9218-71f073ed5dff None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:43.900478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 90/177] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:43.901032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b62861-8273-4dbf-9218-71f073ed5dff None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:43.940174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550462c-e12f-414e-b5d4-cf60329f785e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:43.942436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550462c-e12f-414e-b5d4-cf60329f785e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.041272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.041466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b62861-8273-4dbf-9218-71f073ed5dff None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.050182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.059853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 88/178] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:44.065873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6182a-0640-430a-a106-c501f5efc34e None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.066167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6182a-0640-430a-a106-c501f5efc34e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.066448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a6182a-0640-430a-a106-c501f5efc34e None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.067995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 89/179] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:44.072590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.072885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.073169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.078093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.079256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.079587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.079863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.089983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:44.091165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:44.145058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:44.146523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.155909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 90/180] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:44.156720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.242403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 91/181] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:44.243171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.252672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.265939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aeb36-ac1b-4af7-b151-027502c3e5d3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.279923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.300636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0091-ce08-42a7-9646-2ecfffb7997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.301424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0091-ce08-42a7-9646-2ecfffb7997b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.301712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0091-ce08-42a7-9646-2ecfffb7997b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.301988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0091-ce08-42a7-9646-2ecfffb7997b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.312176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0091-ce08-42a7-9646-2ecfffb7997b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d86f0091-ce08-42a7-9646-2ecfffb7997b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:44.320324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:44.321277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 91/182] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:44.327440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ffb7-1ec5-4dae-b36b-d98e33456cd3 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.328299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ffb7-1ec5-4dae-b36b-d98e33456cd3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.328299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ffb7-1ec5-4dae-b36b-d98e33456cd3 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.328299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 92/183] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:44.328299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.328299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.328299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.342372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:44.343619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:44.346322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd12e-5c06-44dd-90ec-5cd7e4ae9fc0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.379434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.380322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.380606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.380882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.382078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:44.383573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.385429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 92/184] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:44.386124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.410784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 93/185] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:44.411663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.464955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.491727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb60b5-7d5b-4143-ac14-f931f18ff377 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.514392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba4280-b8ef-46bf-bc79-a7b26a002a1a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.516594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.524320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.525125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.525410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.525684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.536643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:44.545500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:44.546570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:44.547538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 93/186] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:44.548219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.553403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9956563-576b-4d50-80c5-ad3ea055c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.554272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956563-576b-4d50-80c5-ad3ea055c625 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.554559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956563-576b-4d50-80c5-ad3ea055c625 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.554836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9956563-576b-4d50-80c5-ad3ea055c625 None admin] PATH_INFO: `/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.556058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9956563-576b-4d50-80c5-ad3ea055c625 None admin] RBAC: Authorizing `identity:get_project(project_id=62113832ab664b2bb7e3e0d5cd1cb899)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:44.557522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9956563-576b-4d50-80c5-ad3ea055c625 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.559370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 94/187] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/projects/62113832ab664b2bb7e3e0d5cd1cb899 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:44.560522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.560817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.561097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.577880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:44.579632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:44.646332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 95/188] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:44.647150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.656202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcb669-9c31-4e25-b741-d2fabf0d6b27 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.690945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.691681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.691969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.692250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.693007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:44.693318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:44.694703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.696060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.703735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 94/189] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:44.704406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.752726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25520c33-507f-4977-b9fb-2bb3a1cc6621 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.754215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.788359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.788949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.789232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.789543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.790556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] RBAC: Adding query filter params (role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=3243d044257f4a73b3712a5d22235385) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:44.790869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:44.792513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.799011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 96/190] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/role_assignments?user.id=3243d044257f4a73b3712a5d22235385&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=be9562507bd540289a07df4afd1c4cee => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:44.799829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.802084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e189-4f6f-4048-8768-6c65e2487021 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.843065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.843925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.844212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.844489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.861317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:44.869559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:44.870500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:44.877436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.925771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56745fd-8310-428e-9c85-dc8d883e04b0 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:44.939918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:44.967107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:44.968214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:44.968505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:44.968874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:44.969573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:44.969878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:44.971268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:44.979753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 97/192] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:44.980377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:44.988585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd14a0-a69f-4807-93b9-af70f1dfe1aa None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.011029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.028632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.029400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.029685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.029956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.030831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=62113832ab664b2bb7e3e0d5cd1cb899, user.id=3243d044257f4a73b3712a5d22235385) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:45.031140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.032752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.039191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 96/193] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/role_assignments?user.id=3243d044257f4a73b3712a5d22235385&scope.project.id=62113832ab664b2bb7e3e0d5cd1cb899&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:45.040008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.096778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cde67b-dc48-45ba-a6e4-b2728ad7916a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.137424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.138347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.138749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.139046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.140279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.141885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.143595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:45.144469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.154798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc88632-bf4b-4206-9dcd-270cdce0e8d5 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.177306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.192637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.193268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.193557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.193836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] PATH_INFO: `/v3/users/7706fd7cd25842db89d93953fe10b0e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.210686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] RBAC: Authorizing `identity:get_user(user_id=7706fd7cd25842db89d93953fe10b0e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.212324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.214321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 97/195] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/users/7706fd7cd25842db89d93953fe10b0e5 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:45.215998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.255430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.266650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b6a9c-5bed-446b-a77a-954011db5279 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.301243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.301839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.302121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.302392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.303133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:45.303465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.304832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.312807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 99/196] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:45.313531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.323621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aaba8-8e35-46b9-8733-2a2106b84516 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.357788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.358680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.358951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.359228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] PATH_INFO: `/v3/users/7706fd7cd25842db89d93953fe10b0e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.361058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] RBAC: Authorizing `identity:get_user(user_id=7706fd7cd25842db89d93953fe10b0e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.362529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.364251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 98/197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/users/7706fd7cd25842db89d93953fe10b0e5 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:45.365022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.412416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.414760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff3652-4505-4aec-856c-312b40f61925 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.447748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.448423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.448711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.448989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.449701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.451150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.466192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec7545-cc5f-4f79-9005-6f746743a04d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.472422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 100/198] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:45 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:45.483571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.502352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.505667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.506351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.506638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.507391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.582267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.583886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.604037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a6a5-2e10-4b05-b776-e703f2a00dd6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.632072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.647113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.648038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.648528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.648641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] PATH_INFO: `/v3/users/9ff6625fc4574070a27f0a03fd61f03c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.651228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] RBAC: Authorizing `identity:get_user(user_id=9ff6625fc4574070a27f0a03fd61f03c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.652709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.654381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 101/199] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/users/9ff6625fc4574070a27f0a03fd61f03c => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:45.655232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.700950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 99/200] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:45.702039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:45.766919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.797270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf76e6-2aaf-4048-a270-3cbf142344db None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.831033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83448422-bceb-41b7-8f21-b4cb3d254323 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:45.843056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.843374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.843666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.843946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.874359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:45.875120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:45.875438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:45.876245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:45.894672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:45.916858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.918337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:45.953084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:45.955308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.002547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:46.022923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 102/201] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:46.023984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:46.062682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 100/202] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:46.064341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:46.115957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:46.131803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f550e-c32d-440a-98b2-3a96475d077d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:46.173208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:46.174356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:46.174639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:46.174913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:46.176137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:46.177575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.177982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16704074-6624-4bac-a5e1-bf28684eabb5 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:46.179273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 103/203] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:46 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:46.180061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:46.218596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:46.219785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:46.220070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:46.220348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:46.221541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:46.223176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.225897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 101/204] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:46 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:46.226510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:46.243215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:46.307362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2e059-a750-4157-a6ca-a7ae8d3a43da None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:46.342934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2a59-482f-49eb-9651-556004d1f32b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:46.351105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:46.352154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:46.352547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:46.352931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:46.355006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:46.356892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.358443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:46.363622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 104/205] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:46 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:46.363622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:46.391478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:46.392747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:46.393447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:46.393916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:46.395102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=7706fd7cd25842db89d93953fe10b0e5) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:46.395927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:46.397960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.405665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 102/206] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:46 2022] GET /identity/v3/role_assignments?user.id=7706fd7cd25842db89d93953fe10b0e5&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:46.406740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:46.532882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723a849-3cb1-4975-9ddd-cf92480f34c3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:46.569024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:46.592670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:46.593344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:46.593630 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:46.593909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:46.595454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] RBAC: Adding query filter params (role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=7706fd7cd25842db89d93953fe10b0e5) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:46.595772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:46.597221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f97c5-2b8f-4274-beee-255338816768 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.603473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 105/207] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:46 2022] GET /identity/v3/role_assignments?user.id=7706fd7cd25842db89d93953fe10b0e5&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=be9562507bd540289a07df4afd1c4cee => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:46.607587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ebc35-a03f-4fe0-9487-1965eb37d932 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:46.648002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:46.648603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:46.648890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:46.649170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:46.650028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] RBAC: Adding query filter params (role.id=96f249ee1b1948f580706967e5a94ee1, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f, user.id=9ff6625fc4574070a27f0a03fd61f03c) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:46.650344 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:46.651863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6bdee1-544d-4539-acbb-f54a3bd82e41 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:46.659699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 103/208] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:46 2022] GET /identity/v3/role_assignments?user.id=9ff6625fc4574070a27f0a03fd61f03c&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=96f249ee1b1948f580706967e5a94ee1 => generated 608 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:47.744448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b7c1d-a4e4-4813-bcd4-df7b31bbd636 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:47.745369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b7c1d-a4e4-4813-bcd4-df7b31bbd636 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:47.745799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b7c1d-a4e4-4813-bcd4-df7b31bbd636 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:47.747723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 106/209] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:47.753779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb35f-81f6-4388-9eb6-914e3aae9596 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:47.754737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb35f-81f6-4388-9eb6-914e3aae9596 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:47.755213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eceb35f-81f6-4388-9eb6-914e3aae9596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:47.772535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0eceb35f-81f6-4388-9eb6-914e3aae9596 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:47.774041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0eceb35f-81f6-4388-9eb6-914e3aae9596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:47.820644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:47.853328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 104/210] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:47.877228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b7c1d-a4e4-4813-bcd4-df7b31bbd636 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:47.941981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470bcfe-dacb-4790-9d07-de5090698267 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:47.942265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470bcfe-dacb-4790-9d07-de5090698267 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:47.942740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470bcfe-dacb-4790-9d07-de5090698267 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:47.944406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 105/211] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:47.949443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:47.949964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:47.950452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:47.967528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:47.968966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:47.982454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b7c1d-a4e4-4813-bcd4-df7b31bbd636 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.018100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:48.018818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.019099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.019399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.020561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:48.022166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:48.024242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 107/212] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:48.029626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:48.042194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 106/213] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:48.066893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:48.081124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:48.132078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339bbfd-f354-4254-8fd0-881faa8b9ed3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.167565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:48.168466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.168909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.169380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.170253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:48.171888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:48.174922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd50671a-bdec-4cd3-b8a1-063c230e5a29 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.183992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:48.196492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 108/214] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:48 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:33:48.223168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:48.224017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.224300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.224576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.237090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:48.245100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:48.246024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:48.246793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 107/215] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:48.254149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:48.366857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e0ffc-5745-4d2e-a25d-bf94a81a9413 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.374801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:48.407392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:48.408058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.408394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.408675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.409430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:48.409736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:48.411111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5d8b-29d9-4fee-aec4-4f7dc1162315 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:48.419887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 109/216] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:48.425780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:48.548301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77d23ca-9d55-4f7a-baf6-290b6d06f595 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.588646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:48.589593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.589884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.590155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] PATH_INFO: `/v3/users/670f866e1de74c4ca4f50d3a9eacb764` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.604765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] RBAC: Authorizing `identity:get_user(user_id=670f866e1de74c4ca4f50d3a9eacb764)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:48.606233 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:48.608160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 108/217] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:48 2022] GET /identity/v3/users/670f866e1de74c4ca4f50d3a9eacb764 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:48.616358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:48.616513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13085-0116-4238-8a41-28cfd85f62ca None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.616513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13085-0116-4238-8a41-28cfd85f62ca None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.616513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f13085-0116-4238-8a41-28cfd85f62ca None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.617307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 110/218] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:48.621404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded99f-3c14-44b8-9c18-6bb5b8431a5d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.621764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded99f-3c14-44b8-9c18-6bb5b8431a5d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.622156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ded99f-3c14-44b8-9c18-6bb5b8431a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.640331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:48.643027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-84ded99f-3c14-44b8-9c18-6bb5b8431a5d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:48.644845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-84ded99f-3c14-44b8-9c18-6bb5b8431a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:48.722982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 111/219] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:48.724546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b440-8cc4-4bb9-a5e9-00b62835c160 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.724931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b440-8cc4-4bb9-a5e9-00b62835c160 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.725283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b440-8cc4-4bb9-a5e9-00b62835c160 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.726729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 112/220] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:48.732433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.732800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.733159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.734433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c115f-816f-4465-86c5-3174ed0b3358 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.763267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:48.764575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:48.772098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:48.773343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:48.773851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:48.774299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:48.855679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:48.857493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:48.859311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 113/221] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:48.860411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:48.880478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:48.889277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:48.966293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3583a-ae1a-4fbf-9c5a-7eb2d78c05f2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:48.966989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 109/222] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 13:33:48.972500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.003284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.004125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.004411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.004691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.015600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:49.023986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:49.024851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:49.025620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 114/223] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:49.026267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.086991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50203e08-ffb8-4940-9b4e-3910779a53fb None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.111699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:49.120965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:49.124530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.125963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.126381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.126724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.134161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549f53a-2fa4-4e08-808c-d98fe086945b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.138505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:49.147722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:49.148642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:49.149416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 110/224] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:33:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:49.150038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.169370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.170242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.170532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.170812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.172043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.174062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.175824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 115/225] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.176595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.259064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40393555-53a3-4d5a-84d4-b8abf65d60ac None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.280388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce2120-95d3-409f-a55e-284d8651457e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.295380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.296107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.296394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.296762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.298161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:49.298473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.299893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.308861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 111/226] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.309772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.320049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.320723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.321010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.321291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.322115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:49.322426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.323939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.332932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 116/227] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.333857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.354379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:49.363812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:49.435757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e74ccd-d6ef-4a9a-875f-24cb080a5d24 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.447064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5bd6c-3e59-4c63-9873-aabcc0d5f7f3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.476402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.477286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.477678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.478031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.479053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=670f866e1de74c4ca4f50d3a9eacb764) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:49.479580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.481096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.487802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 112/228] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/role_assignments?user.id=670f866e1de74c4ca4f50d3a9eacb764&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.488627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.488839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.489847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.490271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.490682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] PATH_INFO: `/v3/users/7706fd7cd25842db89d93953fe10b0e5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.492402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] RBAC: Authorizing `identity:get_user(user_id=7706fd7cd25842db89d93953fe10b0e5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.495066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.497586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 117/229] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/users/7706fd7cd25842db89d93953fe10b0e5 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.506183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.667545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:49.684916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a9b39-b337-4335-bcb3-d3da918a395d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.720776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.721575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.721823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2024ff-5c77-4b71-bd83-c4216b360c30 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.721930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.722126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.723483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.724925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.727106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 118/230] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.732329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.736397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:49.840040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.840938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.841224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.841500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] PATH_INFO: `/v3/users/7706fd7cd25842db89d93953fe10b0e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.842740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] RBAC: Authorizing `identity:get_user(user_id=7706fd7cd25842db89d93953fe10b0e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.843203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3657e-d1bd-41ea-89a2-6cf57a06de74 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:49.844756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.850881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 113/231] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/users/7706fd7cd25842db89d93953fe10b0e5 => generated 283 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:49.852126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:49.901584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:49.902478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:49.902760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:49.903043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/7706fd7cd25842db89d93953fe10b0e5/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:49.907361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae68ce92686a4cbeb2d7439a41eef64e, user_id=7706fd7cd25842db89d93953fe10b0e5, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:49.908829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:49.936278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 119/232] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:49 2022] PUT /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/7706fd7cd25842db89d93953fe10b0e5/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:50.012256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbcd930-3048-4e8d-9135-48f098759d23 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:50.052434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e816c8b-264c-40b2-ab48-e2f8819c8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:50.053336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816c8b-264c-40b2-ab48-e2f8819c8b8d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:50.053620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816c8b-264c-40b2-ab48-e2f8819c8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:50.053896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e816c8b-264c-40b2-ab48-e2f8819c8b8d None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:50.055244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e816c8b-264c-40b2-ab48-e2f8819c8b8d None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:50.056778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e816c8b-264c-40b2-ab48-e2f8819c8b8d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:50.063499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 114/233] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:49 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:50.064950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:50.084085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:50.176743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c752e-4b26-4719-9f55-45d9d16fed09 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:50.218421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab64de6-e4be-4d47-8f08-9e3cc55bd595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:50.219911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64de6-e4be-4d47-8f08-9e3cc55bd595 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:50.220205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64de6-e4be-4d47-8f08-9e3cc55bd595 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:50.220495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab64de6-e4be-4d47-8f08-9e3cc55bd595 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/7706fd7cd25842db89d93953fe10b0e5/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:50.222728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab64de6-e4be-4d47-8f08-9e3cc55bd595 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae68ce92686a4cbeb2d7439a41eef64e, user_id=7706fd7cd25842db89d93953fe10b0e5, role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:50.224276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab64de6-e4be-4d47-8f08-9e3cc55bd595 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:50.246682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 120/234] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:50 2022] PUT /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/7706fd7cd25842db89d93953fe10b0e5/roles/be9562507bd540289a07df4afd1c4cee => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:50.700918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74427f94-dd04-4644-b708-8befd3975b07 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:50.701314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74427f94-dd04-4644-b708-8befd3975b07 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:50.701489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74427f94-dd04-4644-b708-8befd3975b07 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:50.703125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 115/235] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:50.708381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b282-f963-465a-9e51-28965817db05 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:50.708678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b282-f963-465a-9e51-28965817db05 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:50.708961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6b282-f963-465a-9e51-28965817db05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:50.729466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9ec6b282-f963-465a-9e51-28965817db05 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:50.730810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9ec6b282-f963-465a-9e51-28965817db05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:50.831189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 121/236] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:50.866166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74427f94-dd04-4644-b708-8befd3975b07 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:50.906594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909e8c-2dcd-4118-97e7-2759f23cf8de None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:50.907123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909e8c-2dcd-4118-97e7-2759f23cf8de None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:50.907195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38909e8c-2dcd-4118-97e7-2759f23cf8de None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:50.908622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 122/237] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:50.915962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:50.916248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:50.916535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:50.923854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:50.924947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:50.942439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:50.943692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:50.999310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74427f94-dd04-4644-b708-8befd3975b07 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:51.046938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:51.048340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:51.048628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:51.048905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:51.062857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:51.070691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:51.071568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:51.072349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:51.080518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 116/238] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:51.088061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:51.102381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 123/239] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:51.127192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:51.229743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5e142-f99c-488c-abcc-58840aa68433 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:51.232047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:51.278130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:51.278726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:51.279011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:51.279289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:51.280079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:51.280388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:51.282331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:51.305637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 117/240] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:51.316792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:51.390966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47a8ee-3a96-4448-ba1a-c4e5cb87e533 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:51.455036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8eab9-8716-4732-9983-de2a9ed183a4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:51.493234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:51.494041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:51.495298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:51.495610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:51.496431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:51.497304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:51.497588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:51.497862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] PATH_INFO: `/v3/users/f80e78ab6a4f4459a0b4878a0d456227` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:51.499649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:51.502143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:51.503825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 124/241] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:51.511606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:51.526718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] RBAC: Authorizing `identity:get_user(user_id=f80e78ab6a4f4459a0b4878a0d456227)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:51.528567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:51.534102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 118/242] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:51 2022] GET /identity/v3/users/f80e78ab6a4f4459a0b4878a0d456227 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:51.551935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:51.552603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:51.595702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:51.695037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae8a21-e883-4e86-84c5-865760314763 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:51.734657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:51.735408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:51.735693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:51.735974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:51.809251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:51.810996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:51.813652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef988099-e442-4a7f-b41e-b6667765780f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:51.851792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:51.921404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 119/243] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 13:33:51.929487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:51.942304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:51.943083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:51.943461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:51.943828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:51.944611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:51.946124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:51.998980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 125/244] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:51 2022] POST /identity/v3/users => generated 293 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:52.041362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae19b2e-4788-4fc9-99b8-62712a5e0315 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.066451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:52.091334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce98f5e-9709-4da1-ab29-d1343f503469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.092300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98f5e-9709-4da1-ab29-d1343f503469 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.092585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98f5e-9709-4da1-ab29-d1343f503469 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.092861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce98f5e-9709-4da1-ab29-d1343f503469 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.094230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98f5e-9709-4da1-ab29-d1343f503469 None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:52.095764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce98f5e-9709-4da1-ab29-d1343f503469 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:52.097792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 120/245] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:51 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:52.103935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.106736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac58e6-f1fb-4f2a-891a-54bfa2b641e8 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.107024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac58e6-f1fb-4f2a-891a-54bfa2b641e8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.107299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac58e6-f1fb-4f2a-891a-54bfa2b641e8 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.108741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 121/246] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:52.114385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.114746 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.115032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.133002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:52.134208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:52.204060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:52.269151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 122/247] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:52.270694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3e966-1038-45c8-bb0d-dc6e65c55648 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.292036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.316798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.317403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.317690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.317967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.318816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] RBAC: Adding query filter params (role.id=96f249ee1b1948f580706967e5a94ee1, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=f80e78ab6a4f4459a0b4878a0d456227) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:52.319261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:52.320860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922fe7b-01c3-4753-9164-2817b7e9e1fc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:52.327351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 126/248] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/role_assignments?user.id=f80e78ab6a4f4459a0b4878a0d456227&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=96f249ee1b1948f580706967e5a94ee1 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:52.349654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff259-db30-4f19-8601-4d1ab52cfed1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.349654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff259-db30-4f19-8601-4d1ab52cfed1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.349654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff259-db30-4f19-8601-4d1ab52cfed1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.350773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 127/249] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:52.356492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.356824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.357058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.380049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:52.381282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:52.415617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6554-0c7c-43b3-9f39-27dc7ec9b735 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.446566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:52.462326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.463872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.464268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.464648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.479659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:52.484663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 128/250] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:52.489441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:52.490303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:52.491083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 123/251] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:52.496774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.513906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.560764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:52.631001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f609fe-2227-4c42-95d0-9faa6241df8b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.646599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3523b89-2993-4be5-9a42-044fbb506812 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.676205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.676890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.677173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.677449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.678513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:52.678822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:52.680569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:52.692464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 129/252] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:52.697857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.698092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.699121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.699636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.700104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.715734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:52.724062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:52.724979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:52.725743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 124/253] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:33:52.733105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.778504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:52.856044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575cb934-60ef-4d38-bf1b-1ad409a68ddb None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.894302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.895217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.895665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.896653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.897424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:52.897734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:52.899433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ec6b2-2863-4de4-a724-c6d8070e6c64 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:52.910849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fdc75-cd68-4b4f-b093-7052cec3319e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:52.911774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 125/254] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:52.913330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf083-d36c-4f64-8659-f5ede4e12610 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.913618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf083-d36c-4f64-8659-f5ede4e12610 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.913896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf083-d36c-4f64-8659-f5ede4e12610 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.920637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 126/255] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:52.921425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf083-d36c-4f64-8659-f5ede4e12610 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:52.942021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:52.986814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef97b8-85fa-48e4-9469-dd03b5480990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:52.988026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef97b8-85fa-48e4-9469-dd03b5480990 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.988414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef97b8-85fa-48e4-9469-dd03b5480990 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.988809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef97b8-85fa-48e4-9469-dd03b5480990 None admin] PATH_INFO: `/v3/users/670f866e1de74c4ca4f50d3a9eacb764` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:52.991472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef97b8-85fa-48e4-9469-dd03b5480990 None admin] RBAC: Authorizing `identity:get_user(user_id=670f866e1de74c4ca4f50d3a9eacb764)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:52.993098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef97b8-85fa-48e4-9469-dd03b5480990 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:52.995152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 130/256] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/users/670f866e1de74c4ca4f50d3a9eacb764 => generated 297 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:52.999437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:52.999437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:52.999437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.036460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:53.037787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:53.041316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf083-d36c-4f64-8659-f5ede4e12610 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:53.043082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:53.081948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:53.083172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:53.083832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:53.084407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] PATH_INFO: `/v3/users/7706fd7cd25842db89d93953fe10b0e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.085871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] RBAC: Authorizing `identity:get_user(user_id=7706fd7cd25842db89d93953fe10b0e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:53.088032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:53.090692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 127/257] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:52 2022] GET /identity/v3/users/7706fd7cd25842db89d93953fe10b0e5 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:53.096140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:53.167676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 131/258] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:53.168496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:53.215806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2968dc-88f2-4bf3-9d0f-22895f7032f0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:53.253287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:53.254644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:53.255145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:53.255639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.257172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:53.258830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:53.261630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 128/259] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:53 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:53.262606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:53.319757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:53.384690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e93a93-6500-43c3-a140-6d8aed24655a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:53.399271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a25153-b2af-4753-b073-e8764f210050 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:53.416512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:53.448507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:53.449105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:53.449392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:53.449677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.467394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:53.468221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:53.468508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:53.468787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.489783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:53.498684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:53.499596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:53.500501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 129/260] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:33:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:53.501129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:53.625944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:53.628808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:53.645836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:53.652650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04ffd8d-7005-4b53-96a5-53350081cd8a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:53.711078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:53.713514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:53.715145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:53.716277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/670f866e1de74c4ca4f50d3a9eacb764/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.720696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] RBAC: Authorizing `identity:create_grant(project_id=ae68ce92686a4cbeb2d7439a41eef64e, user_id=670f866e1de74c4ca4f50d3a9eacb764, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:53.722350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:53.745723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 130/261] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:53 2022] PUT /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/670f866e1de74c4ca4f50d3a9eacb764/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:53.749544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:53.834338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 132/262] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:53.846360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:53.871449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:53.927470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d221af-af05-43e5-b3ec-b135137e9e8e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:53.976128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:53.976745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:53.977035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:53.977316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:53.978087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:53.978400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:53.979826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:53.991659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 131/263] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:33:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:53.995406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:54.016873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07dee-c8c8-4032-93ca-c0f1ba1bf4fd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:54.032387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:54.061554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:54.062442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.062726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.063567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.065355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:54.066944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:54.070499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 133/264] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:53 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:54.080308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:54.164660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dddc8e-6bc4-4f4d-821a-43f95f490428 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:54.238733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:54.239586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.239870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.240148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] PATH_INFO: `/v3/users/7706fd7cd25842db89d93953fe10b0e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.241999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] RBAC: Authorizing `identity:get_user(user_id=7706fd7cd25842db89d93953fe10b0e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:54.243504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:54.245327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 132/265] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:53 2022] GET /identity/v3/users/7706fd7cd25842db89d93953fe10b0e5 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:54.252772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:54.253386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:54.293417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c20c-adeb-4b84-8cc7-1e7aaddb98fb None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:54.368984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:54.370036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.370526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.371011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.372062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=7706fd7cd25842db89d93953fe10b0e5) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:54.372571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:54.374334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:54.374987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:54.388461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 134/266] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:54 2022] GET /identity/v3/role_assignments?user.id=7706fd7cd25842db89d93953fe10b0e5&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:54.388847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be562b-1977-49b1-af5c-40c428778f17 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:54.443973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:54.444908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.445408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.445827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.523851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:54.525565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:54.622699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:54.647647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:54.647906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 133/267] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:54.793078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e5fbe-ed17-478f-bf56-dd5af7cb76e4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:54.828419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91b92b-a404-4aa0-a52d-6d98066afb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:54.829797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91b92b-a404-4aa0-a52d-6d98066afb3e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.830083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91b92b-a404-4aa0-a52d-6d98066afb3e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.830365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91b92b-a404-4aa0-a52d-6d98066afb3e None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.831619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91b92b-a404-4aa0-a52d-6d98066afb3e None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:54.833075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91b92b-a404-4aa0-a52d-6d98066afb3e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:54.834805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 135/268] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:54 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:54.840885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:54.909046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d52a2-4fbf-4d5f-a314-dad0f525d681 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.909351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d52a2-4fbf-4d5f-a314-dad0f525d681 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.909613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d52a2-4fbf-4d5f-a314-dad0f525d681 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.911344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 136/269] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:54.916408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:54.916704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:54.916991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:54.948837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:54.950046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:54.951061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb6db5b-385b-47e7-b49a-0b795e241b59 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:54.966404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.004774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.005444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.005730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.006006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.006861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] RBAC: Adding query filter params (role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=7706fd7cd25842db89d93953fe10b0e5) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:55.007174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:55.008680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:55.025963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 134/270] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:54 2022] GET /identity/v3/role_assignments?user.id=7706fd7cd25842db89d93953fe10b0e5&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=be9562507bd540289a07df4afd1c4cee => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:55.077964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 137/271] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:55.114959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.186741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.242685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaa217-2d9a-4951-8856-3a7fcb12349e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.281883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517e77a-b6c8-4829-810c-a54e6dabca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.282708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517e77a-b6c8-4829-810c-a54e6dabca69 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.282990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517e77a-b6c8-4829-810c-a54e6dabca69 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.283266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517e77a-b6c8-4829-810c-a54e6dabca69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.296427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517e77a-b6c8-4829-810c-a54e6dabca69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-1517e77a-b6c8-4829-810c-a54e6dabca69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:55.304856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:55.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:55.306501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 135/272] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:55.312408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.349172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d267a04-3e93-4095-9e68-15ad38c89ce4 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.349461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d267a04-3e93-4095-9e68-15ad38c89ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.349668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d267a04-3e93-4095-9e68-15ad38c89ce4 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.352277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 136/273] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:33:55.356334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d983f3-6936-4a60-abfe-30f14a46737b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.356620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d983f3-6936-4a60-abfe-30f14a46737b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.356900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d983f3-6936-4a60-abfe-30f14a46737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.374667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-84d983f3-6936-4a60-abfe-30f14a46737b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:55.377627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-84d983f3-6936-4a60-abfe-30f14a46737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:55.447476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2d2d7-d6e3-423c-a17a-7667092f1041 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.460692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 137/274] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:55.462299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2a6db-9034-4d4c-8fff-f8f6458ef967 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.462810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2a6db-9034-4d4c-8fff-f8f6458ef967 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.463626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2a6db-9034-4d4c-8fff-f8f6458ef967 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.465099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 138/275] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:55.471026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.471571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.472055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.488979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.489647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.489926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.490197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.490939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:55.491245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:55.492488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:55.492652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:55.493683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:55.501706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 138/276] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:55.502450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.507181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.532402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.565387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 139/277] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:55.566048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.625643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ada53-fbf4-4c89-9e74-627239866621 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.659794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.660622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.660881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.661161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.671667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:55.677459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6edbd8-c689-40c9-bdf7-fb9a9ebe192b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:55.680011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:55.680887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:55.681647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 139/278] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:55.682299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.715834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.716711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.716973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.717244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] PATH_INFO: `/v3/users/f80e78ab6a4f4459a0b4878a0d456227` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.718416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] RBAC: Authorizing `identity:get_user(user_id=f80e78ab6a4f4459a0b4878a0d456227)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:55.720381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:55.726415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 140/279] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/users/f80e78ab6a4f4459a0b4878a0d456227 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:55.726415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.760205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.771517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.810015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51e716-39dc-46ab-b074-fbc0b73311d2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.835941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad3b45-758f-481f-83f0-858cde4bf052 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.845604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.846405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.846688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.846966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.848155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:55.849621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:55.851240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 140/280] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:55.852033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.874437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:55.875486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:55.875827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:55.876058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:55.876809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] RBAC: Adding query filter params (name=member) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:55.877120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:55.878498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:55.887304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 141/281] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:55.888435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:55.966219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d3f90-dcb9-41fc-83f3-c1fc754a40f9 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.992303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424a4b-49df-48c7-993e-221005679b65 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:55.993811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:55.996519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:56.001982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:56.002931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.003306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.003678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.004945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:56.006470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:56.008616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 141/282] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:55 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:56.009621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:56.033561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:56.034228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.034511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.034776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.035524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:56.036957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:56.058823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 142/283] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:33:55 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:56.059470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:56.167162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba61dab-fa3b-4b71-aad2-37668b8de440 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:56.188504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f0bab3-56b0-4e61-be8a-a20e25079e08 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:56.213761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:56.214647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.214930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.215204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] PATH_INFO: `/v3/users/12ba7289b2524e38815bb50c91849ae4` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.231280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] RBAC: Authorizing `identity:get_user(user_id=12ba7289b2524e38815bb50c91849ae4)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:56.232829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:56.235289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 142/284] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:56 2022] GET /identity/v3/users/12ba7289b2524e38815bb50c91849ae4 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:56.236615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f876ded-b9c8-43c0-8424-c540db30ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:56.237522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f876ded-b9c8-43c0-8424-c540db30ce39 None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.237810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f876ded-b9c8-43c0-8424-c540db30ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.238087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f876ded-b9c8-43c0-8424-c540db30ce39 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/f80e78ab6a4f4459a0b4878a0d456227/roles/96f249ee1b1948f580706967e5a94ee1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.240199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f876ded-b9c8-43c0-8424-c540db30ce39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae68ce92686a4cbeb2d7439a41eef64e, user_id=f80e78ab6a4f4459a0b4878a0d456227, role_id=96f249ee1b1948f580706967e5a94ee1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:56.240637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:56.241639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f876ded-b9c8-43c0-8424-c540db30ce39 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:56.257875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 143/285] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:33:56 2022] PUT /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/users/f80e78ab6a4f4459a0b4878a0d456227/roles/96f249ee1b1948f580706967e5a94ee1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:33:56.316241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:56.365612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95a602-abe6-4491-b73d-7c9a28c4b742 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:56.404302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:56.404969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.405249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.405523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.406366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, user.id=12ba7289b2524e38815bb50c91849ae4, scope.system=all) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:56.407222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:56.408704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b4c913-5c46-4b17-b9b3-5ab09c972345 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:56.415015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 143/286] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 13:33:56 2022] GET /identity/v3/role_assignments?user.id=12ba7289b2524e38815bb50c91849ae4&scope.system=all&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:33:56.549443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6616d2-6b65-4709-a810-2d1aa4733745 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.549786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6616d2-6b65-4709-a810-2d1aa4733745 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.549959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6616d2-6b65-4709-a810-2d1aa4733745 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.551371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 144/287] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:56.557532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.557812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.558091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.578273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:56.579566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:56.659442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 144/288] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:56.682637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6616d2-6b65-4709-a810-2d1aa4733745 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:56.702268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:56.812039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6616d2-6b65-4709-a810-2d1aa4733745 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:56.854399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:56.855217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:56.855531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:56.855812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:56.872798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:56.880687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:56.881747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:56.882720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 145/289] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:56.888497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:56.967007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:57.031026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7087016-e7b6-4fcb-8c31-c25adc8b86a0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:57.080846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:57.081443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:57.081728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:57.087085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:57.087905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:57.088526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:57.089920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:57.098569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 145/290] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:57.104054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:57.221035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:57.249847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e935d5-0a2a-4454-aa0b-a5c6fe0bc195 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:57.297875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:57.298797 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:57.299079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:57.299394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] PATH_INFO: `/v3/users/670f866e1de74c4ca4f50d3a9eacb764` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:57.300608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=670f866e1de74c4ca4f50d3a9eacb764)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:57.302067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:57.303723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 146/291] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:57 2022] GET /identity/v3/users/670f866e1de74c4ca4f50d3a9eacb764 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:57.309233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:57.427921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e612e-b76a-4855-ae5b-eb5c316a1dce None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:57.445859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:57.471941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:57.472586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:57.472863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:57.473132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:57.566909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:57.568406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:57.697710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:33:57.703013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:57.844641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6d9e6a-af99-41c7-be19-8c5eb0667bf5 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:57.883335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c6a8d-8b86-478f-af5d-a6cb50871faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:57.884214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6a8d-8b86-478f-af5d-a6cb50871faf None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:57.884502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6a8d-8b86-478f-af5d-a6cb50871faf None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:57.884779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c6a8d-8b86-478f-af5d-a6cb50871faf None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:57.892302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c6a8d-8b86-478f-af5d-a6cb50871faf None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:57.893791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c6a8d-8b86-478f-af5d-a6cb50871faf None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:57.895639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 147/293] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:33:57 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:57.901819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:57.926170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:58.051393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159bca46-0b28-48a3-b754-d784a16480b0 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:58.087958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:58.088868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.089146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.089416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.090247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=670f866e1de74c4ca4f50d3a9eacb764) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:58.090557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:58.092032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec829d30-9cc8-4cde-a028-97f9a6b791ac None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:58.104144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 147/294] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:33:57 2022] GET /identity/v3/role_assignments?user.id=670f866e1de74c4ca4f50d3a9eacb764&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:58.701120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69d4c-cd19-4700-9e0a-dbb75f7762e6 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.701630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69d4c-cd19-4700-9e0a-dbb75f7762e6 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.701738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b69d4c-cd19-4700-9e0a-dbb75f7762e6 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.703032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 148/295] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:58.711026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab813d-b78f-4963-9eb6-30214abfa628 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.711482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab813d-b78f-4963-9eb6-30214abfa628 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.711656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab813d-b78f-4963-9eb6-30214abfa628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.730497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5bab813d-b78f-4963-9eb6-30214abfa628 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:58.731722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5bab813d-b78f-4963-9eb6-30214abfa628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:58.821563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 148/296] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:58.844955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b69d4c-cd19-4700-9e0a-dbb75f7762e6 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:58.861115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:58.863105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4af1c3-d5aa-4f5d-a9d1-16e737699066 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.863480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4af1c3-d5aa-4f5d-a9d1-16e737699066 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.863925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4af1c3-d5aa-4f5d-a9d1-16e737699066 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.865397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 149/297] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:58.870645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9827718-333e-40bb-b83f-c6c008cd74cf None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.870934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9827718-333e-40bb-b83f-c6c008cd74cf None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.871210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9827718-333e-40bb-b83f-c6c008cd74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.889741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b9827718-333e-40bb-b83f-c6c008cd74cf None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:58.891950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b9827718-333e-40bb-b83f-c6c008cd74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:58.894405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:58.953490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b69d4c-cd19-4700-9e0a-dbb75f7762e6 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:58.968374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 150/298] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:33:58.969602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebbeea-cdad-460a-8615-e08e2204caac None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.969892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebbeea-cdad-460a-8615-e08e2204caac None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.970166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebbeea-cdad-460a-8615-e08e2204caac None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.971507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 151/299] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:58.972491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8b1c7-324e-4593-a6f2-efae5d4f58c0 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.972773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8b1c7-324e-4593-a6f2-efae5d4f58c0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.973043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8b1c7-324e-4593-a6f2-efae5d4f58c0 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.974356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 152/300] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:33:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:33:58.979365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.979617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.979895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.995104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8359bb-99c1-4136-ac24-d42e8cd04e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:58.995943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8359bb-99c1-4136-ac24-d42e8cd04e63 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:58.996231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8359bb-99c1-4136-ac24-d42e8cd04e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:58.996508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8359bb-99c1-4136-ac24-d42e8cd04e63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:58.996761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:58.997920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:59.007160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8359bb-99c1-4136-ac24-d42e8cd04e63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-4a8359bb-99c1-4136-ac24-d42e8cd04e63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:59.015012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:59.016096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:33:59.016983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 149/301] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:59.017938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.018230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.018509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.034372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:33:59.035585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:33:59.067407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 153/302] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:59.068535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.107663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 150/303] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:33:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:33:59.108501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.112720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.139852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.173192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf667ebb-5d81-4e4c-8455-dce8b97e0524 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.207357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.208083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.208369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.208642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.208785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb54ca-8c63-4720-8157-16d6bd6e3892 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.219225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:59.226941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:59.227885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:59.228657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 154/304] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:59.229324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.244081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.244753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.245041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.245316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.246069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:59.246376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.247802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.256288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 151/305] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.257062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.319226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.329970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754d874-3762-4637-bbc2-79c6c5fe6033 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.354293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b5500-06eb-4b59-8ca5-b8614b29946e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.355992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.364305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.365100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.365389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.365670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.375673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:33:59.383420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:33:59.384264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:33:59.385043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 155/306] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:33:59.386264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.389408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.390200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.390489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.390762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.391974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.393411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.395014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 152/307] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.395804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.488698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda0436-e51d-46b3-971c-56b51ba4f722 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.492012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d86b71-554b-4267-9aef-d00034159fc6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.521186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.521847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.522133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.522418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.523158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:59.523504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.523938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.524801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.524903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.525086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.525363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] PATH_INFO: `/v3/users/e7ea24c7e8e64849a0960701ca6b3772` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.527241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.533530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 156/308] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.534325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.543671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] RBAC: Authorizing `identity:get_user(user_id=e7ea24c7e8e64849a0960701ca6b3772)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.545131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.551915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 153/309] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/users/e7ea24c7e8e64849a0960701ca6b3772 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.551915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.583078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.634232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a6755-2c47-4ee9-bd5a-f6613e63c9ea None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.645650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b70301-2e8d-437e-8974-d1ff7dc37a77 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.667664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.668333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.668622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.668901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.669640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:59.669947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.671366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.678704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.679362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 157/310] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.679457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.679669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.679948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] PATH_INFO: `/v3/groups` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.680158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.680637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.682053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.703952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 154/311] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Jul 6 13:33:59 2022] POST /identity/v3/groups => generated 229 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:33:59.703952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.757036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.803601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22d5e8-97c1-480c-8c6b-a0cd5b5573c2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.818200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:33:59.819923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63066de2-d3f6-438e-86bb-2a6bdb697d8b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.845041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.845983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.846275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.846995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] PATH_INFO: `/v3/users/f80e78ab6a4f4459a0b4878a0d456227` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.848532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] RBAC: Authorizing `identity:get_user(user_id=f80e78ab6a4f4459a0b4878a0d456227)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.849853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.851609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 158/312] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/users/f80e78ab6a4f4459a0b4878a0d456227 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.851722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.863718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:33:59.865104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:33:59.865104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:33:59.865104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:33:59.865759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] RBAC: Adding query filter params (role.id=96f249ee1b1948f580706967e5a94ee1, user.id=e7ea24c7e8e64849a0960701ca6b3772, scope.system=all) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:33:59.866073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:33:59.867597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:33:59.873756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 155/313] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/role_assignments?user.id=e7ea24c7e8e64849a0960701ca6b3772&scope.system=all&role.id=96f249ee1b1948f580706967e5a94ee1 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:33:59.874494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:33:59.978969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1125af-c7bc-48a9-a8ed-d45356670239 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:33:59.995204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81923ef3-a0d6-4060-b98c-45418422b32d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:00.012923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:00.019675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:00.020721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:00.021566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:00.021850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] PATH_INFO: `/v3/users/12ba7289b2524e38815bb50c91849ae4` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:00.023351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] RBAC: Authorizing `identity:get_user(user_id=12ba7289b2524e38815bb50c91849ae4)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:00.024952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:00.026685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/users/12ba7289b2524e38815bb50c91849ae4 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:00.032987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:00.036684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:00.037344 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:00.037623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:00.037894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:00.087198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:00.112066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:00.113892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:00.143698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de0f914-c721-4118-b95a-47b6ab7e83d4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:00.181843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:00.182710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:00.182995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:00.183274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] PATH_INFO: `/v3/system/users/12ba7289b2524e38815bb50c91849ae4/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:00.185096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12ba7289b2524e38815bb50c91849ae4, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:00.186179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:00.198454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 160/315] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Jul 6 13:34:00 2022] PUT /identity/v3/system/users/12ba7289b2524e38815bb50c91849ae4/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:34:00.242978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 156/316] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:33:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:00.248429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:00.359956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aabfa3-893b-49fb-ba44-bb4eb050dc0f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:00.375086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:00.395665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d267f06-43e8-4768-a192-b3e728f8486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:00.396878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d267f06-43e8-4768-a192-b3e728f8486e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:00.397164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d267f06-43e8-4768-a192-b3e728f8486e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:00.397443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d267f06-43e8-4768-a192-b3e728f8486e None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:00.398766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d267f06-43e8-4768-a192-b3e728f8486e None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:00.400239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d267f06-43e8-4768-a192-b3e728f8486e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:00.402254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 161/317] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:00 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:00.408062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:00.426190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:00.514737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f7f2a-2d96-480c-9f01-e4037edfb47c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:00.549594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:00.550593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:00.551074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:00.551592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:00.552615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] RBAC: Adding query filter params (role.id=96f249ee1b1948f580706967e5a94ee1, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e, user.id=f80e78ab6a4f4459a0b4878a0d456227) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:00.553138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:00.554770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6acaeb-c4eb-4889-8211-84d4821ff770 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:00.561301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 157/318] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:00 2022] GET /identity/v3/role_assignments?user.id=f80e78ab6a4f4459a0b4878a0d456227&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=96f249ee1b1948f580706967e5a94ee1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:01.795575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a11d-8a53-4f60-b4d9-f1565b06f199 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:01.796085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a11d-8a53-4f60-b4d9-f1565b06f199 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:01.796158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629a11d-8a53-4f60-b4d9-f1565b06f199 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:01.797578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 162/319] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:01.804660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b576-a62d-41a0-9efc-bc897ed03596 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:01.804660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b576-a62d-41a0-9efc-bc897ed03596 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:01.804660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6b576-a62d-41a0-9efc-bc897ed03596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:01.820142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3ed6b576-a62d-41a0-9efc-bc897ed03596 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:01.821321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3ed6b576-a62d-41a0-9efc-bc897ed03596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:01.889537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 158/320] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:01.911845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a11d-8a53-4f60-b4d9-f1565b06f199 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:01.946137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1cb3-0a73-442b-ac04-1e82cb270749 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:01.946335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1cb3-0a73-442b-ac04-1e82cb270749 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:01.946722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c1cb3-0a73-442b-ac04-1e82cb270749 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:01.948507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 159/321] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:34:01.953439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:01.953733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:01.954013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:01.977128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:01.979976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:01.985992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.021610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629a11d-8a53-4f60-b4d9-f1565b06f199 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.058105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.059010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.059291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.059748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.060848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.062504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.064892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 163/322] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:02.071434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.071573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 160/323] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:02.092027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.127829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.182204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e01e03e-cec1-445d-a188-7cc209f40c24 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.189103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d26cfd-13a1-4973-b1a9-cae3578375b9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.218186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.218842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.219217 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.219456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] PATH_INFO: `/v3/groups` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.220337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.221979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.222429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd94d7-5bb7-4506-8c71-28911d3444fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.223222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd94d7-5bb7-4506-8c71-28911d3444fb None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.223533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd94d7-5bb7-4506-8c71-28911d3444fb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.223809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd94d7-5bb7-4506-8c71-28911d3444fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.232493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.236950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd94d7-5bb7-4506-8c71-28911d3444fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:02.240874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 164/324] 10.222.0.25 () {60 vars in 1134 bytes} [Wed Jul 6 13:34:02 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-12fd94d7-5bb7-4506-8c71-28911d3444fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:02.244959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:02.245893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:02.252456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 161/325] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:02.256478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.283686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc537d8-8649-4196-80a2-259224360848 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.283977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc537d8-8649-4196-80a2-259224360848 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.284261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc537d8-8649-4196-80a2-259224360848 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.286277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 162/326] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:34:02.291699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.291994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.292273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.310417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:02.311604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:02.374112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34eecd-212f-4cd8-975f-113420f40b43 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.383646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 163/327] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:02.384601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.407817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.413144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.414415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.414415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.414415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.415569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:02.415569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.417295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.428329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 165/328] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:02.433970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.527265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157164f-d367-4f10-a4e3-bea8044ab074 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.561564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54cfac-6621-4bec-be35-9313deaf61ca None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.569606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.578465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.579273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.579593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.579872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.597408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:02.603512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:02.604538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:02.605486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 164/329] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:02.612136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.615134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.616256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.616558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.618414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] PATH_INFO: `/v3/users/e7ea24c7e8e64849a0960701ca6b3772` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.619732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] RBAC: Authorizing `identity:get_user(user_id=e7ea24c7e8e64849a0960701ca6b3772)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.621221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.622889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 166/330] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/users/e7ea24c7e8e64849a0960701ca6b3772 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:02.628522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.686306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.741041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90216d3d-d420-4435-b72c-0b0f56ca2737 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.754653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd66b-ff5a-4720-ab49-b81dd3ffbf6a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.778337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.779475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.779988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.780466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.781984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:02.782520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.784157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.793512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 165/331] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:02.798120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.798120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.798120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.798716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] PATH_INFO: `/v3/system/users/e7ea24c7e8e64849a0960701ca6b3772/roles/96f249ee1b1948f580706967e5a94ee1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.799829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e7ea24c7e8e64849a0960701ca6b3772, role_id=96f249ee1b1948f580706967e5a94ee1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.800103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:02.801338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.817447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 167/332] 10.222.0.25 () {58 vars in 1334 bytes} [Wed Jul 6 13:34:02 2022] PUT /identity/v3/system/users/e7ea24c7e8e64849a0960701ca6b3772/roles/96f249ee1b1948f580706967e5a94ee1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:34:02.879010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:02.944658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c5b20-55cc-4504-95e6-b9bbf2402ef2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:02.988558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caeedc-f287-46ea-be6e-01723947f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:02.989492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caeedc-f287-46ea-be6e-01723947f26c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:02.989775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caeedc-f287-46ea-be6e-01723947f26c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:02.990048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caeedc-f287-46ea-be6e-01723947f26c None admin] PATH_INFO: `/v3/users/12ba7289b2524e38815bb50c91849ae4` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:02.991302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caeedc-f287-46ea-be6e-01723947f26c None admin] RBAC: Authorizing `identity:get_user(user_id=12ba7289b2524e38815bb50c91849ae4)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:02.992818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caeedc-f287-46ea-be6e-01723947f26c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:02.994639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 166/333] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/users/12ba7289b2524e38815bb50c91849ae4 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:03.000220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:03.108590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6338341-5a75-4e36-bb80-df3ae73a569b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:03.110122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:03.148542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:03.149195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:03.149479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:03.149811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:03.150647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] RBAC: Adding query filter params (role.id=3210c522a1f5400695e3e0e1ed6789ef, user.id=12ba7289b2524e38815bb50c91849ae4, scope.system=all) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:03.151016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:03.152513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed06ea-a83b-44ec-a29e-82cae99ec890 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:03.167534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 168/334] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 13:34:02 2022] GET /identity/v3/role_assignments?user.id=12ba7289b2524e38815bb50c91849ae4&scope.system=all&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:04.902140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d25fd-d8d9-489b-8647-fc38550526b4 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:04.902981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d25fd-d8d9-489b-8647-fc38550526b4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:04.903534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d25fd-d8d9-489b-8647-fc38550526b4 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:04.905384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 167/335] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:04.910599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:04.911441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:04.911925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:04.933390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:04.934897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:05.014670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 169/336] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:05.052944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d25fd-d8d9-489b-8647-fc38550526b4 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:05.174022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d25fd-d8d9-489b-8647-fc38550526b4 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:05.196152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:05.210810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6e50d-9167-4ad8-b4f4-2a686584946b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:05.212026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6e50d-9167-4ad8-b4f4-2a686584946b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.212513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6e50d-9167-4ad8-b4f4-2a686584946b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.213023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6e50d-9167-4ad8-b4f4-2a686584946b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.226015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6e50d-9167-4ad8-b4f4-2a686584946b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-cfe6e50d-9167-4ad8-b4f4-2a686584946b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:05.234962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:05.235864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:05.236646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:05.239288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 168/337] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:05.248415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:05.261367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0ff61-72c1-40e3-9e75-e6570c2c03d3 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.263501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0ff61-72c1-40e3-9e75-e6570c2c03d3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.263988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0ff61-72c1-40e3-9e75-e6570c2c03d3 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.265574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 169/338] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:05.271744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.272266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.272760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.309612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:05.311179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:05.451754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:05.467417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dadd1-ae02-4fcf-9991-e4bc548c5968 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:05.473242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 170/339] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:05.512817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:05.528708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:05.529408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.529740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.530023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.530791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:05.531107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:05.540550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0243e-5555-4ca4-953b-37505fada85e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:05.560659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 170/340] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:05.561795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce459d8-3562-4fd7-b16e-cd35ac7a8b38 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.562151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce459d8-3562-4fd7-b16e-cd35ac7a8b38 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.562361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce459d8-3562-4fd7-b16e-cd35ac7a8b38 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.563703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 171/341] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:05.571678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce459d8-3562-4fd7-b16e-cd35ac7a8b38 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:05.716168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d18688-d0b7-407c-9d92-7d08c091b508 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:05.738957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:05.764395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67233c6d-b934-4fe7-8032-267d562073a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:05.765593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67233c6d-b934-4fe7-8032-267d562073a9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.766539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67233c6d-b934-4fe7-8032-267d562073a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.767122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67233c6d-b934-4fe7-8032-267d562073a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.777300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce459d8-3562-4fd7-b16e-cd35ac7a8b38 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:05.781030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67233c6d-b934-4fe7-8032-267d562073a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-67233c6d-b934-4fe7-8032-267d562073a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:05.799852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:05.800792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:05.803019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 171/342] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:05.809604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb5ab-e078-4c25-9c5b-7a7314e53feb None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.809604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb5ab-e078-4c25-9c5b-7a7314e53feb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.809604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fb5ab-e078-4c25-9c5b-7a7314e53feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.830586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6f9fb5ab-e078-4c25-9c5b-7a7314e53feb None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:05.833438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6f9fb5ab-e078-4c25-9c5b-7a7314e53feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:05.837308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e05c7a-479b-4e80-a52d-b4e67c4909e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:05.838499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05c7a-479b-4e80-a52d-b4e67c4909e0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.839029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05c7a-479b-4e80-a52d-b4e67c4909e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.839542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e05c7a-479b-4e80-a52d-b4e67c4909e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.870009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:05.922545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 172/343] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:05.924193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f9cc-52e5-4cd6-a0c6-901d96a34cb2 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:05.924485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f9cc-52e5-4cd6-a0c6-901d96a34cb2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:05.924763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185f9cc-52e5-4cd6-a0c6-901d96a34cb2 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:05.926286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 173/344] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:05.927144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f9cc-52e5-4cd6-a0c6-901d96a34cb2 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:05.941585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e05c7a-479b-4e80-a52d-b4e67c4909e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:05.943772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e05c7a-479b-4e80-a52d-b4e67c4909e0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:06.069266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.073675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185f9cc-52e5-4cd6-a0c6-901d96a34cb2 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.083352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 172/345] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:06.083352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662919-1501-486c-943c-34772e147907 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.083352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662919-1501-486c-943c-34772e147907 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.083352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d662919-1501-486c-943c-34772e147907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.102383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6d662919-1501-486c-943c-34772e147907 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:06.103696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6d662919-1501-486c-943c-34772e147907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:06.123038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.124088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.124551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.125128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.126189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:06.126726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:06.128364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:06.143677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 174/346] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:06.144912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.163519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.194878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 173/347] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:06.196102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662919-1501-486c-943c-34772e147907 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.273751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb58d2d-d47d-4951-97a7-5d80ecd3782d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.322080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.322800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.323267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.324672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.334493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d662919-1501-486c-943c-34772e147907 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.338669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:06.347362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:06.348281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 175/348] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:06.350701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.378941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.392115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c863-41ce-47d2-b916-b42e692fd5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.393767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c863-41ce-47d2-b916-b42e692fd5a0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.394069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c863-41ce-47d2-b916-b42e692fd5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.394351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c863-41ce-47d2-b916-b42e692fd5a0 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.396888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c863-41ce-47d2-b916-b42e692fd5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:06.398354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c863-41ce-47d2-b916-b42e692fd5a0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:06.403395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 174/349] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:06.404862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3349ad-a469-4cba-9c0d-d1af8dfc737b None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.405188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3349ad-a469-4cba-9c0d-d1af8dfc737b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.405475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3349ad-a469-4cba-9c0d-d1af8dfc737b None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.407617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 175/350] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:06.408319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3349ad-a469-4cba-9c0d-d1af8dfc737b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.471409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.478612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9618c-e471-4f41-93b5-efff6c30ee51 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.520788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.520788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.521069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.521333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.544666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3349ad-a469-4cba-9c0d-d1af8dfc737b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.589139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.589864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.590148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.590426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.606107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:06.606839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:06.607628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:06.615870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:06.616752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:06.617542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:06.622726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 176/351] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:06.623705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.642516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.742605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 176/352] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:06.743527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.757677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05e82b-1cf2-4e74-be19-da32ffea9fb3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.774276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.810577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.811256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.811626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.811901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.814896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:06.814896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:06.814896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f82ff-8cf8-4ca1-bc86-0839ed5b73e3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:06.825362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 177/353] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:06.826476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.826764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.827643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.845751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:06.846870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:06.865391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4b432-006c-450a-af1f-4598d6f7840b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:06.902756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:06.920129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:06.922396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:06.922396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:06.922396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:06.930822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:06.932331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:06.935151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 177/354] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:06.935151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:06.939011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 178/355] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:06.939733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.052212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975e57d-3836-4524-b8f8-ccca99699342 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.054919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.066503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76056b64-53b1-40de-be15-ee74f456ea2f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.097685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.099361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.100074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.100379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.101560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.103002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.105137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 179/356] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:07.106027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.108092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.108773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.109058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.109700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.110472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] RBAC: Adding query filter params (name=member) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:07.111524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.112193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.122296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 178/357] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:07.124883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.177889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.226664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1752c-c146-48f1-b739-657bd8207d8a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.245449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97583d66-4ca8-4230-a1fc-373726f2fd58 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.270043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.270814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.271099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.271940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] PATH_INFO: `/v3/users/e7ea24c7e8e64849a0960701ca6b3772` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.273432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] RBAC: Authorizing `identity:get_user(user_id=e7ea24c7e8e64849a0960701ca6b3772)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.274777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.279441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 180/358] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/users/e7ea24c7e8e64849a0960701ca6b3772 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:07.279441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.286095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.286783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.287071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.287987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.288216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:07.288530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.289964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f3d55-7f39-4f5d-9e81-6bef2afb794c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.300934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 179/359] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:07.302212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ca473-f2ba-4878-b294-553ceeb171c3 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.302501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ca473-f2ba-4878-b294-553ceeb171c3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.302779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ca473-f2ba-4878-b294-553ceeb171c3 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.305094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 180/360] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:07.305870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ca473-f2ba-4878-b294-553ceeb171c3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.333966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.429933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0705b0-3f2d-46f5-ba2d-f361436c397f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.438697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ca473-f2ba-4878-b294-553ceeb171c3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.458274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.488338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.489167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.489463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.489749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.490511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.491618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.492197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.492609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.494319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.496168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.497815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 181/361] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:07.498584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.506833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:07.516540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:07.517436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:07.518206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 181/362] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:07.523889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.621219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80c1f4-b202-416c-881e-638cac3ac116 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.647039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.651149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7438c6-cb36-4eca-a461-d406925c2476 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:07.666562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.668368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.668368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.668368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.697957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:07.698537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.698824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.699099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.699968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] RBAC: Adding query filter params (role.id=96f249ee1b1948f580706967e5a94ee1, user.id=e7ea24c7e8e64849a0960701ca6b3772, scope.system=all) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:07.700277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.701730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a7f18-dd6d-46fb-86f9-ad5ca9e5dc6f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.714770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 182/363] 10.222.0.25 () {56 vars in 1308 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/role_assignments?user.id=e7ea24c7e8e64849a0960701ca6b3772&scope.system=all&role.id=96f249ee1b1948f580706967e5a94ee1 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:07.716348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:07.716637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:07.716913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:07.731973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.741407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:07.742636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:07.762081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:07.763602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:07.845589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 183/364] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:07.846456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.901893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 182/365] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:07.902780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:07.958132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:07.980227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa39ff0-1823-407d-80b5-f3df8003774a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.013070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.033430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.034101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.034382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.034660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.035613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:08.035942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.037407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.040704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163ad72-133c-47f8-a2c5-8c9944fc3684 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.044577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 184/366] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=be9562507bd540289a07df4afd1c4cee => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:08.045455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.107670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.111394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.111394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.111394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.111394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:08.111394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.111826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.123935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 183/367] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:08.125735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.195437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9079382-192a-4925-be92-0f426c2fd515 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.243694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.244426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.244715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.244997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.261618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:08.272042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4f6f3-ea1d-4f5f-ad40-5c6324a0aa69 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:08.272743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:08.273609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:08.274389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:08.275435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 185/368] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:08.276364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.298562 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.313195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.314070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.314353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.314625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.315920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.317434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.319504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 184/369] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:08.320327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.340263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.422229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb88aae-9497-4742-92ea-96c662b8d611 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.447570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890747-3579-4ae5-ae84-27bc6bb0c9d3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.468915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.469595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.469883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.470166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.486621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.487693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.488178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.488630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.489697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:08.490197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.492099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.502703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:08.503886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.562137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.564187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.586207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.599611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.637943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18590dd-da27-4a7e-aaa9-8cbd3eaf731c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.677234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.678097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.678381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.678660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.680895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.682332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.684162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 186/371] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:08.684771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.709322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 186/372] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:08.710566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.790287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083f58-de36-4cb8-969a-c7e824fbe726 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.827059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.827746 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.828036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.829518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.838877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e95ac-16d9-4023-99fd-21df2ea4f86b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:08.840415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.855871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:08.885753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:08.886749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:08.887228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:08.887727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:08.888896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:08.889500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.891186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:08.898047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 187/373] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:08.899266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:08.903816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:08.903816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.021401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 187/374] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:09.027912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:09.077643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54489071-dbc3-45be-8b1d-7bd966d41aa6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.093100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:09.137816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.139040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.139628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.140098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.141820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:09.146417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.148996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 188/375] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:08 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:09.154202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:09.156049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb2aefc-5551-46a0-a1ad-73c8851e1131 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.195067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.196030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.196320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.196861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] PATH_INFO: `/v3/projects/3dbd2977ff724d4a80575343d59991ff` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.200128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3dbd2977ff724d4a80575343d59991ff)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:09.201604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.203882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 188/376] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:09 2022] GET /identity/v3/projects/3dbd2977ff724d4a80575343d59991ff => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:09.210444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:09.234062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:09.344258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d6472-a288-4b73-9f39-49aaa602f96c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.392619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.393820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.394676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.395157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.396577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:09.398256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.400457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aacedc-35f4-4922-bf4a-208866e207f5 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.400693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 189/377] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:09 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:09.408112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:09.415384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:09.440505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.441444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.441732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.442061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] PATH_INFO: `/v3/groups/f820c7e379284263838c6c52848f366a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.447787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] RBAC: Authorizing `identity:get_group(group_id=f820c7e379284263838c6c52848f366a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:09.449248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.455348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 189/378] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:09 2022] GET /identity/v3/groups/f820c7e379284263838c6c52848f366a => generated 229 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:09.457732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:09.560856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a83b90-87d2-495d-a588-deabd595d7ae None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.568350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973641a-4f09-43ae-a44b-edafcb9b44b7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.573426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:09.602295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.603349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.603872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.604380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.605555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:09.605938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.606205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:09.606792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.607177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.607589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.608279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b334a4f7-402e-405d-9bb8-6121167c8b58 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.608689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] RBAC: Adding query filter params (group.id=f820c7e379284263838c6c52848f366a, role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=3dbd2977ff724d4a80575343d59991ff) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:09.609101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:09.610652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d22881-6156-472f-a3de-c4ca46b4ac93 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:09.615443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 190/379] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:09 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=be9562507bd540289a07df4afd1c4cee => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:09.616870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65bd59-ce6b-40d9-9b34-00f38fac6a15 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.617303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65bd59-ce6b-40d9-9b34-00f38fac6a15 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.617722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65bd59-ce6b-40d9-9b34-00f38fac6a15 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.618444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 190/380] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:09 2022] GET /identity/v3/role_assignments?group.id=f820c7e379284263838c6c52848f366a&scope.project.id=3dbd2977ff724d4a80575343d59991ff&role.id=729660ef64b242119ec8e65a05f1e171 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:09.619732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 191/381] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:09.625517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.625874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.626231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.657815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:09.659185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:09.704006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:09.768583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 191/382] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:09.808885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65bd59-ce6b-40d9-9b34-00f38fac6a15 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:09.934421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65bd59-ce6b-40d9-9b34-00f38fac6a15 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:09.971671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:09.972839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:09.973317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:09.973807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:09.990410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:09.998659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:09.999617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:10.000974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:10.003705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 192/383] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:10.012431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:10.155121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9595702d-2976-47a7-afe2-b32f867d3b94 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:10.207481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:10.208523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.209010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.209485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.210438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] RBAC: Adding query filter params (name=member) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:10.210955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:10.212584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:10.227039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 192/384] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:10.232819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:10.277843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:10.356149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5b4ac-83b7-44f2-869f-5df93087aff3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:10.392417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf93429-c6c8-4957-aa6b-b703c525162b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:10.393656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93429-c6c8-4957-aa6b-b703c525162b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.394147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93429-c6c8-4957-aa6b-b703c525162b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.394624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf93429-c6c8-4957-aa6b-b703c525162b None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.396032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf93429-c6c8-4957-aa6b-b703c525162b None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:10.397694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf93429-c6c8-4957-aa6b-b703c525162b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:10.399845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 193/385] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:10 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:10.405037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:10.441234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:10.544347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f746d337-35b5-4ee0-bd99-bd235fa9bc78 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:10.563046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9106e-f302-4178-b6b3-938ef3d87360 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.563404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9106e-f302-4178-b6b3-938ef3d87360 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.563637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9106e-f302-4178-b6b3-938ef3d87360 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.565276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 194/386] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:10.570354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.570640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.570920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.595351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:10.596229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.596509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.596784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.600814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:10.602277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:10.604316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:10.605512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:10.608211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 193/387] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:10 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:10.614425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:10.710767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 195/388] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:10.758793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:10.794169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:10.804724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7174e-bb0e-4815-8253-0d9b0e66ee82 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:10.807809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:10.865336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:10.865989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.866284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.866563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.875429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] RBAC: Authorizing `identity:create_grant(project_id=8a9625e843ca4297a7b9b2cd63ffa98f, group_id=556ed907808c46fcb49bf970ee0a4cd1, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:10.876885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:10.892487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79e6a7-4bbf-4dbb-b091-11e2def5852c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:10.907441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 194/389] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 13:34:10 2022] PUT /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:34:10.931694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:10.932887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:10.933376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:10.933919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:10.946362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:10.955791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:10.956748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:10.957516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:10.960329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 196/390] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:10.968567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:11.111900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721dae6-5770-4483-9805-f471c6f3571b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:11.149215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:11.150070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:11.150465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:11.150871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:11.151800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:11.152219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:11.153734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:11.164192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 195/391] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:11.169326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:11.273104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:11.282706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133d6a9-85c0-4d13-a85b-35aacc876baa None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:11.318349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:11.319199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:11.319581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:11.319859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:11.321031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:11.322466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:11.324412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 197/392] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:11 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:11.330186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:11.360966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:11.465346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8563f-997d-46c2-b9b9-a6668d9c2f66 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:11.506780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55969b18-4f9b-4e5a-ab2e-b2c3b32721e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:11.507683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969b18-4f9b-4e5a-ab2e-b2c3b32721e8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:11.507966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969b18-4f9b-4e5a-ab2e-b2c3b32721e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:11.508240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55969b18-4f9b-4e5a-ab2e-b2c3b32721e8 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:11.509458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55969b18-4f9b-4e5a-ab2e-b2c3b32721e8 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:11.510897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55969b18-4f9b-4e5a-ab2e-b2c3b32721e8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:11.512937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 196/393] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:11 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:11.518892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:11.636327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc2f88-bc96-4bd8-b979-0f1a357c5171 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:11.670869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc7461-fd1b-4b0d-b126-c2bc9325d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:11.672385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc7461-fd1b-4b0d-b126-c2bc9325d714 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:11.672670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc7461-fd1b-4b0d-b126-c2bc9325d714 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:11.672942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc7461-fd1b-4b0d-b126-c2bc9325d714 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:11.675173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc7461-fd1b-4b0d-b126-c2bc9325d714 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a9625e843ca4297a7b9b2cd63ffa98f, group_id=556ed907808c46fcb49bf970ee0a4cd1, role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:11.676661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc7461-fd1b-4b0d-b126-c2bc9325d714 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:11.692124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 198/394] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 13:34:11 2022] PUT /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/be9562507bd540289a07df4afd1c4cee => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:11.740102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5085d-4148-4d77-afcb-0d2d86e69647 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:11.740283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5085d-4148-4d77-afcb-0d2d86e69647 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:11.740568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5085d-4148-4d77-afcb-0d2d86e69647 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:11.742284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 197/395] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:11.748157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3a6b-bf3f-4ddc-801e-2e2792b86118 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:11.748484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3a6b-bf3f-4ddc-801e-2e2792b86118 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:11.748771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3a6b-bf3f-4ddc-801e-2e2792b86118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:11.767074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-322b3a6b-bf3f-4ddc-801e-2e2792b86118 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:11.768322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-322b3a6b-bf3f-4ddc-801e-2e2792b86118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:11.790309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:11.857033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 199/396] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:11.881411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5085d-4148-4d77-afcb-0d2d86e69647 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:11.981795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:11.998784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5085d-4148-4d77-afcb-0d2d86e69647 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.036786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80d522-e2e7-49fd-8282-295ae2f69fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.037583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d522-e2e7-49fd-8282-295ae2f69fd9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.037866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d522-e2e7-49fd-8282-295ae2f69fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.038141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80d522-e2e7-49fd-8282-295ae2f69fd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.049718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80d522-e2e7-49fd-8282-295ae2f69fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:12.055351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447d12d-71a0-4590-a022-77297395170e None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.055666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447d12d-71a0-4590-a022-77297395170e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.055948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447d12d-71a0-4590-a022-77297395170e None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.057583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 200/397] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2a80d522-e2e7-49fd-8282-295ae2f69fd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:12.057779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:12.058814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:12.060152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 198/398] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:12.064700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447d12d-71a0-4590-a022-77297395170e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.066913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.067211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.067515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.085465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:12.086681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:12.158243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 199/399] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:12.185615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.261839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447d12d-71a0-4590-a022-77297395170e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.293490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:12.312047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.312763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.313053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.313587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.314839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:12.315445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:12.317619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285be38-d7d4-425a-9d70-6f64dd7d0980 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:12.320210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3771ab6d-70e4-41ac-ad58-bb2691c99f11 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.328937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 201/400] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:12.330771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712f83-03b2-48cd-ab90-038595af211f None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.331067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712f83-03b2-48cd-ab90-038595af211f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.331368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41712f83-03b2-48cd-ab90-038595af211f None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.335389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 202/401] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:12.336194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41712f83-03b2-48cd-ab90-038595af211f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.358016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:12.363628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac541116-10d3-47c3-89c1-1e45006c27f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.364148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541116-10d3-47c3-89c1-1e45006c27f8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.364435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541116-10d3-47c3-89c1-1e45006c27f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.364820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac541116-10d3-47c3-89c1-1e45006c27f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.377336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac541116-10d3-47c3-89c1-1e45006c27f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ac541116-10d3-47c3-89c1-1e45006c27f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:12.386713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:12.387651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:12.388932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:12.392981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 200/402] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:12.394277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.394632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.394907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.414620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:12.415886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:12.464691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41712f83-03b2-48cd-ab90-038595af211f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.495698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 201/403] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:12.496636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.519922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.520844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.522405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.522700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.525757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:12.530172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:12.533740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 203/404] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:12.535596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.591705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:12.625168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c457cc8-773d-4335-aa8b-bf1e3b0de79e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.641069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8028a1-d0f6-48e6-86b7-90395fb89a6f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.655649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:12.661224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.662110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.662640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.663069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.664007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:12.664634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:12.666312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:12.675869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 202/405] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:12.677162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.678860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.679817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.680248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.680558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.691653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:12.699656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:12.700647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:12.701457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:12.702088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 204/406] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:12.703481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.785731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720fa784-efbc-49ff-8309-ff21e6aca6f7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.815696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:12.817097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c209-7965-4663-87ec-5b3b487fccb2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.822049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.823029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.823241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.823574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.824862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:12.826301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:12.833502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 203/407] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:12.833502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.860867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.862017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.862498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.862968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.864371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:12.866055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:12.868185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 205/408] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:12.869122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.881962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:12.939905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36f862-5971-4c15-8a38-02db16f8eb4b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:12.974697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:12.975593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:12.975970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:12.976347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:12.977196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:12.977753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:12.979080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:12.988485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 204/409] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:12.989400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:12.999410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b7177b-c3a6-416b-b9e9-a8770137e2b3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.037159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.037787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.038167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.038541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.040638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=ae68ce92686a4cbeb2d7439a41eef64e, group_id=556ed907808c46fcb49bf970ee0a4cd1, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:13.042193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:13.063592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 206/410] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 13:34:12 2022] PUT /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:13.064702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:13.071345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:13.151778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:13.156122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77144644-7afa-4e95-a648-257679f32d7f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.204694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef1e1d-5643-4a0b-9e19-d228be6c7b55 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.246050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.246929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.247209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.247510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.248714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:13.251030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:13.252821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 205/411] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:12 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:13.258800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:13.276829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.278029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.278382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.278752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] PATH_INFO: `/v3/groups/f820c7e379284263838c6c52848f366a` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.280102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] RBAC: Authorizing `identity:get_group(group_id=f820c7e379284263838c6c52848f366a)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:13.281646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:13.283664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 207/412] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:13 2022] GET /identity/v3/groups/f820c7e379284263838c6c52848f366a => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:13.288794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:13.413164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66090ee3-8238-418f-8e0c-195c0ded732f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.448012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4cca5-6c63-4ed5-92ab-521486419e56 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.473432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:13.491145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.492490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.492986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.493454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] PATH_INFO: `/v3/projects/3dbd2977ff724d4a80575343d59991ff` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.494895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d672e4b-4dc3-441e-acac-872bc76f875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.495342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] RBAC: Authorizing `identity:get_project(project_id=3dbd2977ff724d4a80575343d59991ff)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:13.495821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672e4b-4dc3-441e-acac-872bc76f875c None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.496109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672e4b-4dc3-441e-acac-872bc76f875c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.496387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672e4b-4dc3-441e-acac-872bc76f875c None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.497742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:13.500585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 208/413] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:13 2022] GET /identity/v3/projects/3dbd2977ff724d4a80575343d59991ff => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:13.501775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d672e4b-4dc3-441e-acac-872bc76f875c None admin] RBAC: Authorizing `identity:create_grant(project_id=ae68ce92686a4cbeb2d7439a41eef64e, group_id=556ed907808c46fcb49bf970ee0a4cd1, role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:13.503209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d672e4b-4dc3-441e-acac-872bc76f875c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:13.505770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:13.510312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:13.532692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 206/414] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 13:34:13 2022] PUT /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e/groups/556ed907808c46fcb49bf970ee0a4cd1/roles/be9562507bd540289a07df4afd1c4cee => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:34:13.535107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61289d2-1d35-4193-a384-f60c1ad3462f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.535451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61289d2-1d35-4193-a384-f60c1ad3462f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.535739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61289d2-1d35-4193-a384-f60c1ad3462f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.539551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 207/415] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:13.544390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.544696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.544952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.568190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:13.570268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:13.639125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f84ac-5a92-4fa0-a84e-c7821f238d0f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.670887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 208/416] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:13.677685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.678561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.678843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.679128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] PATH_INFO: `/v3/projects/3dbd2977ff724d4a80575343d59991ff/groups/f820c7e379284263838c6c52848f366a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.681136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] RBAC: Authorizing `identity:create_grant(project_id=3dbd2977ff724d4a80575343d59991ff, group_id=f820c7e379284263838c6c52848f366a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:13.682570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:13.699891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 209/417] 10.222.0.25 () {58 vars in 1442 bytes} [Wed Jul 6 13:34:13 2022] PUT /identity/v3/projects/3dbd2977ff724d4a80575343d59991ff/groups/f820c7e379284263838c6c52848f366a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:13.700638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:13.826535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d9305-bf71-4dc7-bd9d-faa3b7b8724b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:13.852394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:13.873014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:13.873827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:13.874111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:13.874384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:13.886698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:13.895158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:13.896051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:13.896820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 209/418] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:13.903456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:13.981562 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:14.028755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df496f49-c6a0-4925-925d-a2e732b784fb None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:14.082484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:14.083078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.083383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.083661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.084414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] RBAC: Adding query filter params (name=member) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:14.084720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:14.086092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48f7ea-e6ca-4263-a809-1256cb222a29 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:14.097182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 210/419] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:14.102694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:14.106959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c144-c992-4c2c-a0c1-b65d1e011388 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.107252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c144-c992-4c2c-a0c1-b65d1e011388 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.107655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c144-c992-4c2c-a0c1-b65d1e011388 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.109903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 211/420] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:34:14.123358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.123358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.123358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.151940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:14.153974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:14.272842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33da67-2d16-477b-a87b-43bb7512bd84 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:14.295765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 212/421] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:14.318593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:14.319246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.319548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.319824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.332470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:14.391768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:14.404857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:14.406996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:14.445387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:14.496142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6db5ce-19eb-49e4-aec1-f067aeee428e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:14.534384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:14.535302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.535683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.536029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.547609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:14.555839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:14.556720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:14.557500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 213/422] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:14.563575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:14.630561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 210/423] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:14.648979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:14.675402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5f40b-d7af-4620-8acd-9cc117760e7c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:14.692624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:14.712302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:14.712967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.713503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.713783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.714525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:14.714831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:14.716231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:14.724766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 214/424] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:14.730117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:14.844382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a5c96-8947-46f6-926f-80af07b4ea31 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:14.874917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:14.878806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:14.879480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:14.879962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:14.880240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:14.929523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:14.941560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fe0eb-0275-4b09-a823-d0ac7e182dd7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:14.959344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:14.959344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.025068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.025936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.026224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.026500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.029152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:15.030723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.033371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 211/425] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:14 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:15.051862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:15.069290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 215/426] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:15.075976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:15.184922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:15.210298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab28509-de6d-476e-9b18-86a8739e7852 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:15.241563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430f987-f8ee-451a-91a5-f19fe5e57981 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:15.246462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.247330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.247617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.247888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] PATH_INFO: `/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.249174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=8a9625e843ca4297a7b9b2cd63ffa98f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:15.251174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.253421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 216/427] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:15 2022] GET /identity/v3/projects/8a9625e843ca4297a7b9b2cd63ffa98f => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:15.258751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:15.288011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.288883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.289167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.289441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.290634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:15.292100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.294017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 212/428] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:15 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:15.312748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:15.333715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:15.370554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca9dd4-8f9a-4028-b781-31f7bdce5fd0 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:15.407394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.408249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.408529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.408802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.410019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:15.411534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.413440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 217/429] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:15 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:15.419021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:15.435823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:15.522512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890dba70-247d-4d1f-b17b-6c6ba722a9ec None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:15.533617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f30c7c-f33f-4b07-af2f-9709bf975cf1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:15.573321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.573980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.574262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.574537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.575386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:15.575730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:15.577122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1802ef9-4e70-4d39-8e9c-c16b8cc1da4d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.585632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 218/430] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:15 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=be9562507bd540289a07df4afd1c4cee => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:15.596643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.597382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.600410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.600685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.601556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:15.601866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:15.603388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e7f85-4cc8-40da-b1ff-82fbf2204020 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:15.615888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 213/431] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:15 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=8a9625e843ca4297a7b9b2cd63ffa98f&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 611 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:15.621907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b00f8-e715-4acd-8542-f687a0d15fac None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.622539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b00f8-e715-4acd-8542-f687a0d15fac None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.623037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b00f8-e715-4acd-8542-f687a0d15fac None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.624873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 219/432] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:15.636369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.636705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.636932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.662074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:15.663296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:15.758755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 214/433] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:15.793504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b00f8-e715-4acd-8542-f687a0d15fac None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:15.914939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:15.946917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b00f8-e715-4acd-8542-f687a0d15fac None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:15.985708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd519b-e948-407b-af69-4d2ec268c58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:15.986513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd519b-e948-407b-af69-4d2ec268c58b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:15.986796 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd519b-e948-407b-af69-4d2ec268c58b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:15.987071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd519b-e948-407b-af69-4d2ec268c58b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:15.998276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd519b-e948-407b-af69-4d2ec268c58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-defd519b-e948-407b-af69-4d2ec268c58b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:16.006417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:16.007293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:16.008115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 220/434] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:16.013898 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.022326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.124874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d6d6-f368-4c38-b13f-2d6a3119de94 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.150779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffddbde-4772-48e8-98a4-4e157561ced1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.151077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffddbde-4772-48e8-98a4-4e157561ced1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.151359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffddbde-4772-48e8-98a4-4e157561ced1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.154021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 221/435] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:16.159506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec545-5bb0-4a24-b4b7-baf1d185abca None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.159798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec545-5bb0-4a24-b4b7-baf1d185abca None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.160080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ec545-5bb0-4a24-b4b7-baf1d185abca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.162399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.163065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.163367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.163649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.164401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:16.164707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:16.166087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:16.174873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 215/436] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:16.180089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.182357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e77ec545-5bb0-4a24-b4b7-baf1d185abca None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:16.184673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e77ec545-5bb0-4a24-b4b7-baf1d185abca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:16.255597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.264679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 222/437] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:16.267742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4aae-9ce0-4d84-bbd7-4920b3abf29e None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.268032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4aae-9ce0-4d84-bbd7-4920b3abf29e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.268307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db4aae-9ce0-4d84-bbd7-4920b3abf29e None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.269601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 223/438] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:16.274880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.275170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.275507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.294049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:16.295151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:16.301102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9db8db-e6dc-4439-8b93-a8c8f27af2f5 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.341554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.342214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.342506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.342787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.364043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.370413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 224/439] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:16.371147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.411046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:16.412538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:16.470948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de221b8-71d8-476b-9cdf-5eaf0cf56cfd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.481644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.503762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.504558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.504845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.505125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.514763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 216/440] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 13:34:16.515141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:16.516048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:16.523515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:16.524436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:16.525225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 225/441] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:16.525857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.587202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.614046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf25d0a-97eb-4223-a10b-45f409934897 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.628970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e42fb-9cf7-4801-91ac-81cb84d7aee5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.648780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.649579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.649860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.650130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.660133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:16.664153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.665008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.665294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.665569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.666745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:16.668225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:16.669326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:16.670122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:16.670730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:16.670805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 217/442] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:16.670875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 226/443] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:16.672023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.675196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.700220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.772315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afff315-ae94-4d77-a257-d8796504b31b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.777326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee105847-fd7b-4fb4-9813-9e504c1979c1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.803840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.805780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.806491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.806765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.807063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.807870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:16.808183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:16.809560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:16.813757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.814598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.814877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.815154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.816347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:16.817770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:16.818286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 218/444] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:16.819074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.824071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 227/445] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:16.824071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:16.909749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:16.919668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571568e8-2b77-427f-9793-bbe11fa4f3a3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.920690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65690f-7ec4-447d-b5ec-b3fff16946f3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:16.952487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.953181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.953462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.953737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.953972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:16.954501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:16.954596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:16.954808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:16.954909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:16.955134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:16.956312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:16.964406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 219/446] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:16.969199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.018516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.026801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.028229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.063251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799fc1ea-cda3-4285-9a6d-a95dede8c624 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.096096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.096745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.097023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.097294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.098123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=3210c522a1f5400695e3e0e1ed6789ef, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:17.098432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.099878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.105451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 220/447] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=3210c522a1f5400695e3e0e1ed6789ef => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:17.106220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.134218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.146014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 228/448] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 13:34:17.147458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.225620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530cae13-64a2-487d-afa2-82146729a837 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.260979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.262952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.263700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.263999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.264715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.268702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4924fb5-8ef0-4fce-a0d2-84f56936df70 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.312100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.313001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.313300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.313574 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] PATH_INFO: `/v3/projects/3dbd2977ff724d4a80575343d59991ff` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.314940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] RBAC: Authorizing `identity:get_project(project_id=3dbd2977ff724d4a80575343d59991ff)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.316440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.318151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 229/449] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/projects/3dbd2977ff724d4a80575343d59991ff => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:17.324264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.345918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.347422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.369367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.452609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd93de1-2da8-4623-9b6a-84b45abc5857 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.461816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 221/450] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:17.470023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.491244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.492165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.492450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.492732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] PATH_INFO: `/v3/groups/f820c7e379284263838c6c52848f366a` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.493916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] RBAC: Authorizing `identity:get_group(group_id=f820c7e379284263838c6c52848f366a)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.495425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.497044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 230/451] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/groups/f820c7e379284263838c6c52848f366a => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:17.502772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.532024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.565999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64621ce7-c443-4fd1-b525-1c3f77357d1b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.581373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.599856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2793f088-4e46-41d9-87fa-437e3f66b57e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.600320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.600818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.601096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.601371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] PATH_INFO: `/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.602543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] RBAC: Authorizing `identity:get_project(project_id=ae68ce92686a4cbeb2d7439a41eef64e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.604001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.605660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 222/452] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/projects/ae68ce92686a4cbeb2d7439a41eef64e => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:17.611605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.634066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.634725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.635017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.635291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.636158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] RBAC: Adding query filter params (group.id=f820c7e379284263838c6c52848f366a, role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=3dbd2977ff724d4a80575343d59991ff) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:17.636474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.637908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.644285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 231/453] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/role_assignments?group.id=f820c7e379284263838c6c52848f366a&scope.project.id=3dbd2977ff724d4a80575343d59991ff&role.id=729660ef64b242119ec8e65a05f1e171 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:17.712715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a15b56-a1c2-4f0d-9acf-a1501a6d7de6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.747499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf42f-6440-4704-a22f-464a72d511b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.748371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf42f-6440-4704-a22f-464a72d511b7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.748649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf42f-6440-4704-a22f-464a72d511b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.748918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf42f-6440-4704-a22f-464a72d511b7 None admin] PATH_INFO: `/v3/groups/556ed907808c46fcb49bf970ee0a4cd1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.750181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bf42f-6440-4704-a22f-464a72d511b7 None admin] RBAC: Authorizing `identity:get_group(group_id=556ed907808c46fcb49bf970ee0a4cd1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.751663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bf42f-6440-4704-a22f-464a72d511b7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.753316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 223/454] 10.222.0.25 () {56 vars in 1180 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/groups/556ed907808c46fcb49bf970ee0a4cd1 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:17.759288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:17.861426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:17.868328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83f5e9c-8bc4-4ec4-86b2-cf84818ccfa5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:17.900717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:17.901363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:17.901654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:17.901935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:17.902766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] RBAC: Adding query filter params (group.id=556ed907808c46fcb49bf970ee0a4cd1, role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:17.903081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:17.904554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd5f3e-9716-4485-aea8-0f817e017fdd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:17.910908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 232/455] 10.222.0.25 () {56 vars in 1376 bytes} [Wed Jul 6 13:34:17 2022] GET /identity/v3/role_assignments?group.id=556ed907808c46fcb49bf970ee0a4cd1&scope.project.id=ae68ce92686a4cbeb2d7439a41eef64e&role.id=be9562507bd540289a07df4afd1c4cee => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:20.422520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037fdd2-fba8-44aa-8c28-fd6b8dd013dc None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.423519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037fdd2-fba8-44aa-8c28-fd6b8dd013dc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.424007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037fdd2-fba8-44aa-8c28-fd6b8dd013dc None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.425830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 224/456] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:20.431131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3146a3-1e70-4c00-b681-50855843a299 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.432004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3146a3-1e70-4c00-b681-50855843a299 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.432497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3146a3-1e70-4c00-b681-50855843a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.455616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7f3146a3-1e70-4c00-b681-50855843a299 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:20.457250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7f3146a3-1e70-4c00-b681-50855843a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:20.548428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 233/457] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:20.584645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037fdd2-fba8-44aa-8c28-fd6b8dd013dc None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:20.655251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:20.676154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453164-5338-43cc-a246-98634f41dc47 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.676749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453164-5338-43cc-a246-98634f41dc47 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.677236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453164-5338-43cc-a246-98634f41dc47 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.679144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 234/458] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:20.684363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.684834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.685252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.716499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037fdd2-fba8-44aa-8c28-fd6b8dd013dc None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:20.728194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:20.729395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:20.792076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90595498-9162-4a92-962d-b61348cb434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:20.793528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90595498-9162-4a92-962d-b61348cb434a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.794008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90595498-9162-4a92-962d-b61348cb434a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.794494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90595498-9162-4a92-962d-b61348cb434a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.819184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90595498-9162-4a92-962d-b61348cb434a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:20.820704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90595498-9162-4a92-962d-b61348cb434a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-90595498-9162-4a92-962d-b61348cb434a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:20.853941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:20.854839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:20.855718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:20.855718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:20.855718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:20.855718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:20.856424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 225/459] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:20.857392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a47c-e620-4ad8-8bd7-b09392828318 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.857675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a47c-e620-4ad8-8bd7-b09392828318 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.857951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723a47c-e620-4ad8-8bd7-b09392828318 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.859429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 226/460] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:20.865406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:20.865689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:20.865960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:20.866603 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 235/461] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:20.867682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:20.895538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:20.897908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:20.904420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:20.995418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 227/462] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:20.995418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.021911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.031478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba65f1f-8ff6-4d89-a780-b0868d19dbac None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.074463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.075528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.076023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.076547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.077539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:21.078596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.080244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.091310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02f8d4-096e-47c2-a3d0-a36a10d89736 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.093205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 236/463] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:21.094252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.131966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.132200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.132496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.132755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.143675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.145114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:21.163466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:21.164366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:21.165210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:21.165210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:21.165210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:21.165210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:21.165210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 228/464] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:21.165922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.182624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.205506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedcb056-7289-4aa1-b481-78337c28a322 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.241116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.241999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.242288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.242564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.253626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.255016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.260302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:21.273150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:21.274151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:21.275082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:21.275082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:21.275082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:21.275082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:21.275082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 237/465] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:21.279169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7356cc5-6ceb-4b2f-a49e-7647e27c5d2b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.279677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.315772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3226f-0de6-4770-82e4-245aee4a19c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.316700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3226f-0de6-4770-82e4-245aee4a19c9 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.317124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3226f-0de6-4770-82e4-245aee4a19c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.317536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3226f-0de6-4770-82e4-245aee4a19c9 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.318379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3226f-0de6-4770-82e4-245aee4a19c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.320084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3226f-0de6-4770-82e4-245aee4a19c9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.342008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 229/466] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:34:21 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:21.344071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a5aa-97df-4925-be8a-e82be7df6e4d None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.344502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a5aa-97df-4925-be8a-e82be7df6e4d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.345254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8a5aa-97df-4925-be8a-e82be7df6e4d None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.347100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 230/467] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:21.348181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a5aa-97df-4925-be8a-e82be7df6e4d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.410646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80622639-c4c3-4c51-8d60-392cb66e82f6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.450765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.458490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.459248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.460108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.460849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.461797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:21.462272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.465226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070dcea-d563-4d41-896c-66448314fcac None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.482916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 238/468] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:21.482916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.482916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.482916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.499196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:21.501237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:21.511279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8a5aa-97df-4925-be8a-e82be7df6e4d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.551162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.551872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.552162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.552437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.553599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:21.553919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.556152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.571802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 231/469] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:21.573010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.576881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.596975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 239/470] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:21.600852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.715342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8b00-3d5d-4e59-9ad4-1d20cec06698 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.734318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa69ba1-f9c3-44a7-ace2-764203ce86de None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.758646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.759340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.759629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.759899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.760667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.761561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.763547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.780325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584f4983-5a12-4669-bafe-9aa84f383cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:21.781631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4983-5a12-4669-bafe-9aa84f383cc7 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.782036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4983-5a12-4669-bafe-9aa84f383cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.782315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584f4983-5a12-4669-bafe-9aa84f383cc7 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.783023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f4983-5a12-4669-bafe-9aa84f383cc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:21.784820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584f4983-5a12-4669-bafe-9aa84f383cc7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:21.795511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 232/471] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:34:21 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:21.798325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:21.821420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 240/472] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:34:21 2022] POST /identity/v3/users => generated 248 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:21.901439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:21.934709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083501bd-f9c1-4ff7-bada-569fa3a38005 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.935039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083501bd-f9c1-4ff7-bada-569fa3a38005 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.935270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083501bd-f9c1-4ff7-bada-569fa3a38005 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.936718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 241/473] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:34:21.943029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:21.943371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:21.943618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:21.976520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:21.977388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461b1d5-20fa-4989-93b6-ab7dab9c4cc3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:21.977752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:22.024273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:22.025015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:22.025303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:22.025585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:22.041659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:22.044059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:22.068003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:22.068906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:22.070378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:22.070378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:22.070378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:22.070378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:22.070378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 233/474] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:22.074868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:22.094112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 242/475] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:22.116267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:22.213033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7de516-f9c5-42ce-9711-81b8a6450816 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:22.225868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:22.252299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a3ede-48a4-4e9c-b95e-b0f222e86c39 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:22.253503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:22.254337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:22.255462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:22.255752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:22.256496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:22.256806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:22.258192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:22.273501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 234/476] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:22.275114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:22.280613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:22.297683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:22.298648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:22.298937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:22.299220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:22.300178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:22.302265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:22.309568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.sql.core [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 13:34:22.309568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 13:34:22.309568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [parameters: {'id': '62d0af1b15454470938aa63702b58957', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 13:34:22.309568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86852) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application conn.query(q) Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result.read() Jul 06 13:34:22.327080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return ref.to_dict() Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 13:34:22.328818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application next(self.gen) Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application yield resource Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application next(self.gen) Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise self.value Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application session.commit() Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 13:34:22.329800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.session.flush() Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application compat.raise_( Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 13:34:22.330631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 13:34:22.331549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application conn.query(q) Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result.read() Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 13:34:22.332354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [parameters: {'id': '62d0af1b15454470938aa63702b58957', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:22.334385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 13:34:22.340587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:22.342577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 243/477] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 13:34:22 2022] POST /identity/v3/roles => generated 144 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:22.342577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:22.478192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af25e4-255e-41b1-8714-6a528c4b1024 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:22.533566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04810dac-48ea-4fe1-b95f-db8afb847ce0 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:22.538276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:22.538946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:22.539226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:22.540293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:22.545315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:22.547347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:22.584049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 235/478] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:34:22 2022] POST /identity/v3/users => generated 249 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:22.595417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b949fa5-7138-4dd2-a870-a8cb4f28ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:22.596313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949fa5-7138-4dd2-a870-a8cb4f28ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:22.596598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949fa5-7138-4dd2-a870-a8cb4f28ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:22.596874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b949fa5-7138-4dd2-a870-a8cb4f28ffc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:22.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b949fa5-7138-4dd2-a870-a8cb4f28ffc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-5b949fa5-7138-4dd2-a870-a8cb4f28ffc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:22.623277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:22.625636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 13:34:22.627782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:22.631627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 244/479] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:22.631860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:22.681486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:22.773942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6291cef1-f7ab-4b60-bad1-133f9a5676ea None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:22.815690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:22.816372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:22.816654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:22.816927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:22.817686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:22.817988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:22.819398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887033-79e4-47ed-878a-e18ae433df11 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:22.828568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 236/480] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:23.929090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd35c-72f9-423e-975c-f707194f8ba2 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:23.929596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd35c-72f9-423e-975c-f707194f8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:23.929669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abd35c-72f9-423e-975c-f707194f8ba2 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:23.931438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 245/481] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:23.936732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:23.937721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:23.937891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:23.964439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:23.965643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:24.046034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 237/482] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:24.081044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd35c-72f9-423e-975c-f707194f8ba2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.126851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:24.220962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abd35c-72f9-423e-975c-f707194f8ba2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:24.264390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e0dbf-8e47-4f8d-9256-c5bc0c2318c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:24.265616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0dbf-8e47-4f8d-9256-c5bc0c2318c6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.266131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0dbf-8e47-4f8d-9256-c5bc0c2318c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.266616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e0dbf-8e47-4f8d-9256-c5bc0c2318c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.282749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e0dbf-8e47-4f8d-9256-c5bc0c2318c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-4f4e0dbf-8e47-4f8d-9256-c5bc0c2318c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:24.290886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:24.291787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:24.292571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:24.295201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 246/483] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:24.302008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.339107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:24.416797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d434b9-ff91-409d-9ca2-1f6ac5f31e62 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.417424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d434b9-ff91-409d-9ca2-1f6ac5f31e62 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.417907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d434b9-ff91-409d-9ca2-1f6ac5f31e62 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.419537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 247/484] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:24.424460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774cf7-16e3-4156-ac53-3ede3b2aa140 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.424750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774cf7-16e3-4156-ac53-3ede3b2aa140 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.425028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53774cf7-16e3-4156-ac53-3ede3b2aa140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.452111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-53774cf7-16e3-4156-ac53-3ede3b2aa140 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:24.457820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-53774cf7-16e3-4156-ac53-3ede3b2aa140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:24.458422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0669-bd43-4c3b-b8bc-540ef3fa7ea4 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:24.496388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:24.497167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.497447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.497723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.498463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:24.498768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:24.500201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e0b79-b162-426c-97f1-ce0855b57c6b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:24.508651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 238/485] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:24.509844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae215f-893b-46ab-a113-a16ee4154e49 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.510125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae215f-893b-46ab-a113-a16ee4154e49 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.510398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae215f-893b-46ab-a113-a16ee4154e49 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.516828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 239/486] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:24.517561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae215f-893b-46ab-a113-a16ee4154e49 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.543342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 248/487] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:24.543342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.543342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.543342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.573194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:24.574845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:24.591389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:24.619770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:24.642430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae215f-893b-46ab-a113-a16ee4154e49 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:24.650911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 249/488] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:24.652100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.689056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:24.690423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.690423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.690594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.701405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:24.703810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:24.722914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:24.723804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:24.724631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:24.724631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:24.724631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:24.724631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:24.727761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 240/489] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:24.728752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.764825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64f5ee-b0e0-45ae-900f-7030ee9fa712 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:24.810658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:24.811834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.812888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.813368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.824954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:24.834236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:24.835198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:24.836017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:24.838197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bce1a8-695e-4e09-90b3-b0e8a9b5ca00 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:24.843930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 250/490] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:24.845474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.859802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:24.873168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:24.879186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:24.880476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:24.881024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:24.881495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:24.893475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:24.902119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:24.902979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:24.903802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:24.906389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 241/491] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:24.907439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:24.966094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cbab8a-261a-4e32-bfc7-c85264c19797 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.003006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.003729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.003991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.004276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.005112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:25.005428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.006942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.020670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 251/492] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:25.025122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.026813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df57a956-620c-4af4-983e-0b8480dd10b7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.063827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.064968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.065448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.066003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.066990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:25.067566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.069321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.079501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 242/493] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:25.080705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.107559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.149500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a09739-9a6d-45ae-a3c3-e355056ba35e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.157341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.192554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.193282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.193628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.194001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.194921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:25.195236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.196805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.210354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 252/494] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:25.211328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.217151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0b2f1-fade-4f5e-837b-f1f6d7b2e345 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.256144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.256932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.257210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.257482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.268092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.269554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:25.285830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:25.286840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 243/495] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:25.288090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.322304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6ca63-7cc0-498c-a9ea-d54faabb9372 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.352554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.358200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.359465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.359750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.360027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.370959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.372453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-61ea3346-83ea-44a7-a9a0-5e2883679f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:25.390144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:25.390976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:25.391823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:25.391823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:25.391823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:25.391823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:25.391823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 253/496] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:25.392700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b80be-c590-484a-b629-ddff631a926b None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.392997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b80be-c590-484a-b629-ddff631a926b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.393278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51b80be-c590-484a-b629-ddff631a926b None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.394553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 254/497] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:25.395251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b80be-c590-484a-b629-ddff631a926b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.402159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab89211c-d7de-46ab-b949-937045dc73c3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.416251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.437839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.438625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.438912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.439190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.452401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.454675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-c0840ee2-e8de-47c6-8044-c78575c193cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:25.472917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:25.473859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:25.474709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:25.474709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:25.474709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:25.474709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:25.474709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 244/498] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:25.475629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaca3b1-010f-4c1b-9b34-59e0a8602c3f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.475915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaca3b1-010f-4c1b-9b34-59e0a8602c3f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.476192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaca3b1-010f-4c1b-9b34-59e0a8602c3f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.477592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 245/499] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:25.478476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.479052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.479146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.495780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:25.496954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:25.504173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51b80be-c590-484a-b629-ddff631a926b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.536852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.537509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.537795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.538069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.538897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:25.539203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.540674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.559989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 246/500] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:25.560800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.583375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 255/501] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:25.584220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.627342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.654673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.661211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2b383-c034-45b6-9921-1eb5f8bcc404 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.684438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8884c-acf3-406b-b07a-365b88cad3fd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.694608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.695273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.695580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.695856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.696577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:25.696887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.698255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea6769-1b11-4d29-ac60-908e7a52a9c0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.709313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 247/502] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:25.710475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.710765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.711044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.717096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.717755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.718041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.719702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.720442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:25.720756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:25.722150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:25.729049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:25.730258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:25.739778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 256/503] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:25.739778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.799725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 248/504] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:25.800484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.839255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e3ee8-c138-4a89-821f-6a16fa671aea None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.840810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.875292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.876196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.876492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.876772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.887384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:25.895595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:25.896517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:25.897311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 257/505] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:25.897942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:25.903529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:25.919381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64122f41-c6a2-4765-80e6-d0dcf553d3ab None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:25.954163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:25.954804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:25.955076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:25.955380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:25.995631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb114d97-04d2-401d-9d87-65d78ea045a1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.020299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.021765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.028327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.029107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.029394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.029670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.039920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.041789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:26.057401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:26.058315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:26.059175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 258/506] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:26.059755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.087668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.108806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.124133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 249/507] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:26.124948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.164594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbb75e-b9f4-4fdc-b953-bb265dd87c96 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.196965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.197754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.198039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.198306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.206110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.207603 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.218127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef1c63-2e73-4dce-b334-209ce661e18b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:26.222200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:26.223095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 259/508] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:26.224332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.253137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.253924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.254204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.254474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.264211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.266185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:26.283516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:26.284405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:26.285229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:26.285229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:26.285229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:26.285229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:26.285229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 250/509] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:26.285494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.305193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.323524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d34c7-20f0-4bc7-8ad2-08b56e6fd13e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.328725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.357667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.358333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.358614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.358915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.359748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:26.360075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.361445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.369443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 260/510] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:26.370239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.393460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d9ec5-e22b-409b-b7a1-a7394ff834f7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.426199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.426807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.427093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.427400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.428237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:26.428548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.429990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.468278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 251/511] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:26.469026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e358bd-df4b-4952-a5c3-3d907e5b1343 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.469134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.504994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.505774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.506056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.506329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.517137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.518585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.521172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:26.536167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:26.537172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:26.538005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:26.538005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:26.538005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:26.538005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:26.538005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 261/512] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:26.538270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.566698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.572769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0120c0-6c91-47a2-a5f1-e90837078fae None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.605828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.606497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.606782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.607061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.607931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:26.608244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.609739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.626967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 252/513] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:26.627789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.638179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b136e4-eb4b-4c68-b8da-9f8fe87a57c7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.672266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.672949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.673231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.673509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.674225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:26.674531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.675963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.688174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 262/514] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:26.688919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.724533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d07d-2354-4867-ab3f-79abb02e5faf None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.747168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.759469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.760259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.760544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.760822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.770925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.772404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.793184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453b192f-e59a-497f-b7d8-3297283fc01f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:26.793776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:26.794613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:26.795483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:26.795483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:26.795483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:26.795483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:26.795483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 253/515] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:26.795839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.807310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:26.833109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.833763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.834051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.834330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.895174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34193-4e39-47e2-919e-30f2e187f180 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:26.902304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.903797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.929403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:26.930057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:26.930412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:26.930696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:26.931442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:26.931756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:26.933152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:26.945241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 254/516] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:26.945973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:26.961548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.005881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 263/517] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:27.006678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.007534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.044932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc78a9-1b67-4e82-acbd-b70b61f73c2c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.077557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.078197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.078483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.078759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.103637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c625bd-b232-4d6a-9326-9ad3c90ddfb5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.136734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.137395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.137682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.137961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.138659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.140127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.142864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.144340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.160548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 264/518] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:34:27 2022] POST /identity/v3/users => generated 247 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:27.161415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.177875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.218006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.261037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 255/519] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:27.261912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.282808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12852de-ade0-405d-88d9-eed713f7f068 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.325730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.327226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.327226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.327226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.328163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:27.328489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.329879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.342806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 265/520] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:27.344056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.377741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d156ea5-c0a6-4716-96cd-54bbe2ccf658 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.414368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.415163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.415479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.415761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.420813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.424192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.425761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:27.440501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:27.441533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 256/521] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:27.447040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.462088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b344a-2b20-4eb3-8df1-263698789f97 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.475201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.501153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.501959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.502246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.502524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.514034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.516174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:27.536707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:27.537577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:27.538397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:27.538397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:27.538397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:27.538397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:27.542572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 266/522] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:27.543259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.552383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02b337-ae02-434a-9e4f-a099ce57c326 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.586546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.587351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.587662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.587938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.599307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.600782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:27.619534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:27.620570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:27.621535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:27.621535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:27.621535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:27.621535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:27.621535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 257/523] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:27.621870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.658322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617d73c-b6f2-4ff8-b04a-cb94f5acdc76 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.681881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.692732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.693533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.693821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.694101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.701468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.703520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.714687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:27.719613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:27.720493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:27.721366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 267/524] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:27.721907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.745270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b405d6-6040-4378-90e6-9baf955d1969 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.781529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.782190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.782478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.782912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.783583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:27.783864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.786900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.809080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 258/525] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:27.810023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.828990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36514cca-76cb-40c4-b521-b034071c8290 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.866991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.867695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.868021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.868303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.869020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:27.869329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.870714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.882841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 268/526] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:27.883552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.924767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2e245-11e7-4105-aba5-4c00135d2351 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:27.929701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.964750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:27.965772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:27.966069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:27.966349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:27.967084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:27.967424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:27.968834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:27.976109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:27.982153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 259/527] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:27.983231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:27.991637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5739cf-6482-44f6-8217-bbe556b491a6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.029549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.030244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.030541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.030734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.031617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:28.031902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.033348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.051117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 269/528] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:28.052038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.092237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac659cc1-42d6-46e3-ba5e-a4e8988c5786 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.125938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.126754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.127046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.127345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.128774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=943294440c3a4d309ff6e6165dcb9d32) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:28.129240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.131400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.137122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 260/529] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:27 2022] GET /identity/v3/role_assignments?user.id=943294440c3a4d309ff6e6165dcb9d32&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:28.137991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.181384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996a1d96-5fd4-455e-93e6-dcab17f1b083 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.183301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:28.222300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.223376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.223736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.224087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.226561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:28.232560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.234870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:28.251866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:28.252787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:28.253619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:28.258096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 270/530] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:28.259158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.278844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1121e-208e-4ba7-8eb3-89e3a7194e98 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.319553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.320377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.320667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.320945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.328619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.330098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:28.345613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:28.346479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:28.347571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 261/531] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:28.348400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.394802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc1a95-1d14-450d-ac7a-c2e7da238c8b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.441432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.442691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.443609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.444364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.452055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5fb67-6839-4b3a-9425-ded23ca71258 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.478389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:28.489531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:28.492160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.492846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.493154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.493698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.494582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:28.494902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.496565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.509678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 262/532] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:28.510583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.546076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.548415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.636319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb405cc-38a1-48e5-b9ee-dd014a33a792 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.678511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.679184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.679506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.679786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.680587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:28.680901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.682365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.687038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 271/533] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:28.687947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.714660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 263/534] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:28.715305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.801551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:28.809765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:28.886252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6316a6d-47d9-4069-bd84-dddcf6ca0bd3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.916042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24eb77-ff05-4416-8ec9-ad6320b190d7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:28.958079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.958744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.959031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.959306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:28.960166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=695790c0f33f40e1a0ea7e70318d419a) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:28.960481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:28.961924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:28.974854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 272/535] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/role_assignments?user.id=695790c0f33f40e1a0ea7e70318d419a&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:28.976119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:28.992996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:28.994195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:28.994713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:28.995194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.015917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:29.019111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:29.069141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:29.070088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:29.070926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:29.070926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:29.070926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:29.070926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:29.073326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 264/536] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:29.081435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:29.201888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f36c39-6397-4af7-a4c1-01242b934d71 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:29.239551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:29.271265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:29.272333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.272825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.272930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:29.273845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.274909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=e9625fcd053644e3914df6762e067788) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:29.275414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:29.277024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39159298-3a90-488c-8d07-036a90dac60b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:29.280468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06dbc1-c8e7-416d-8d7a-e4d74ac15431 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:29.285264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 273/537] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:28 2022] GET /identity/v3/role_assignments?user.id=e9625fcd053644e3914df6762e067788&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:29.286857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228290c-052c-4eee-90a7-f656778f7648 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.287395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228290c-052c-4eee-90a7-f656778f7648 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.287882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228290c-052c-4eee-90a7-f656778f7648 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.293952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 274/538] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:29.295807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.296503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.296996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.315848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:29.317590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:29.323433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:29.324130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.324416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.324696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.325513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:29.325826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:29.327374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:29.350152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 265/539] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:29.352246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:29.454374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 275/540] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:29.494645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:29.545816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95507f0a-f9ec-49fa-a9a8-73580502a39a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:29.632228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20ca20-fb10-441a-b0e6-e803fc9bad5c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:29.636076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:29.636885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.637169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.637447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.652428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:29.653883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:29.656695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:29.674175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:29.675344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.675801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.676272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:29.687603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:29.688430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:29.689235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:29.691185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 266/541] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:29.696107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:29.697160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:29.715089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:29.716193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:29.717039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:29.720679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 276/542] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:29.726398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:29.731218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:29.849051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974e2ef-a241-4e8a-bc0c-778e13810b82 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:29.914634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:29.916984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:29.920008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:29.920431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:29.921897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:29.922350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:29.925370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:29.945302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 267/543] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:29.952301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:29.954654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c971c2-5aea-4c20-a63f-eda45ca3b276 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:30.026361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:30.027345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.027769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.028182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.029067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:30.029513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:30.031586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:30.053860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 277/544] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:30.059356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:30.093082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:30.121458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e882e-fa23-4631-a5c4-dbc231e0b461 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:30.143668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:30.158165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:30.158839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.159127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.159431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.160260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=f0dd5d8814384b14b46e8e6fd4fab9f6) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:30.160574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:30.162014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:30.167955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 268/545] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:29 2022] GET /identity/v3/role_assignments?user.id=f0dd5d8814384b14b46e8e6fd4fab9f6&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:30.229166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45d49-9e10-4c4f-83e6-03d1ad95dbac None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:30.266176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:30.267049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.267349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.267653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.280239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:30.281781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-c9ed9fc5-c946-4129-87d9-4a608cb0f724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:30.300483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:30.301374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:30.302193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:30.302193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:30.302193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:30.302193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:30.302193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 278/546] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:30.307763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:30.419032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7396e-ce2c-4891-b05f-2feb6b63c995 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:30.457457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:30.458656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.459119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.459253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbceb3-c2f3-45ea-afb0-1f00e9688e74 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.459463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.459557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbceb3-c2f3-45ea-afb0-1f00e9688e74 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.459800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdbceb3-c2f3-45ea-afb0-1f00e9688e74 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.460191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:30.460500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:30.461851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 279/547] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:30.461958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:30.468353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.468649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.468931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.472875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:30.480299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 269/548] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:30.486109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:30.494622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:30.501757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:30.606381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 280/549] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:30.632938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:30.664948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:30.711698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1922101-8583-4f7b-8d5c-1a686e75c2b0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:30.748509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:30.750030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.750366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.750649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] PATH_INFO: `/v3/users/swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.767684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:30.767684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:30.775241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:30.776627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:30.777662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 270/550] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:30.783618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:30.813681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5d3f7-38f0-42a8-9c8e-4a22c5470382 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:30.887881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:30.888604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:30.888889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:30.889165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:30.898022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:30.916822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:30.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:30.931673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:30.932462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:30.942467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 281/551] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:30.948314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:30.986744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ff7891-7adb-47dd-bbd3-0c104899dfad None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.051054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.051759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.052044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.052321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.053167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:31.053475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.054918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:31.085794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 271/552] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 13:34:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:31.092995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.097234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.119495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537d79b-a029-41c4-91c7-cf9bc1408dd9 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.178443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.179035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.179340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.179623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.180376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:31.180687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.182073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:31.199162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 282/553] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:31.207963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.263917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d53d213-8c9b-454f-a114-39983b7a99a3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.282698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.300633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549802a-96bc-494b-99a1-bb9282bcce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.301302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549802a-96bc-494b-99a1-bb9282bcce85 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.301968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549802a-96bc-494b-99a1-bb9282bcce85 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.302454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549802a-96bc-494b-99a1-bb9282bcce85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.373479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549802a-96bc-494b-99a1-bb9282bcce85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.375068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549802a-96bc-494b-99a1-bb9282bcce85 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:31.383085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a4342-c87e-449b-98d9-38df28969356 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.420319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.421525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.421959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.422478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.434460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.436336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:31.443862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-b3f89017-afae-4d23-9cbd-7cbe759f15a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:31.456732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:31.457765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:31.458669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:31.458669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:31.458669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:31.458669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:31.460979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 283/554] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:31.462614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12867f3-3449-4643-a6bf-460084fc0870 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.463088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12867f3-3449-4643-a6bf-460084fc0870 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.463808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12867f3-3449-4643-a6bf-460084fc0870 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.465681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 284/555] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:31.467737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12867f3-3449-4643-a6bf-460084fc0870 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.489583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 272/556] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:31.491679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.492081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.492462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.511494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:31.512703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:31.526670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.586063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12867f3-3449-4643-a6bf-460084fc0870 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.586314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 273/557] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:31.587163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.623992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.625501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.625987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.626492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.627525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:31.628147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.629713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:31.649237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 285/558] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:31.651988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.715557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9b0d0-a245-42d8-a4b5-3d16eca0404c None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.725141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.766417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.767222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.767539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.767848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.771878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca8914-6b7e-4237-a0ad-09c1edabb465 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.783313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.786500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:31.794474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:31.812247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:31.813130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:31.813996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:31.813996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:31.813996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:31.813996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:31.813996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 274/559] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:31.814957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.818237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0706-9dd0-4cb0-b520-59c05b9eabe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.820638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0706-9dd0-4cb0-b520-59c05b9eabe0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.821061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0706-9dd0-4cb0-b520-59c05b9eabe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.821474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0706-9dd0-4cb0-b520-59c05b9eabe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.840819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d0706-9dd0-4cb0-b520-59c05b9eabe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-474d0706-9dd0-4cb0-b520-59c05b9eabe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:31.849397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:31.850388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:31.851282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:31.851947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 286/560] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:31.852868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b869-a530-4b90-930a-c6e7bc9d35f9 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.853160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b869-a530-4b90-930a-c6e7bc9d35f9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.853435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b869-a530-4b90-930a-c6e7bc9d35f9 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.855820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 287/561] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:31.856712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341b869-a530-4b90-930a-c6e7bc9d35f9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:31.933902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c405a-a492-47ad-9bea-1fb5a8050bef None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.968695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341b869-a530-4b90-930a-c6e7bc9d35f9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:31.975671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:31.976470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:31.976755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:31.977033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:31.985899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:31.986495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:31.988229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.003698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.004362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.004646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:32.004745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:32.005635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:32.006640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:32.007183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.007183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.007183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.007394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11848bc-7249-4545-84f6-d5d9242dd99e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.010578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 275/562] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:32.011449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.020372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 288/563] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.021691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.022062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.022323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.039822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:32.041003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:32.079266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.112009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 289/564] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:32.112853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.142004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272ea91-caaa-4f30-8fc2-ca31f674b400 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.182301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.182975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.183257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.183561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.184311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.184614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.185976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.194765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 276/565] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.195597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.225657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea746f-a27d-4702-b426-8244a47f4c92 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.235850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.262902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.263604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.263900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.264179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.265044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.265359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.266832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.289824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 290/566] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.289824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.303140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c29d348-9962-4abc-9ef0-8adb5b28093b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.322262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.337233 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.338031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.338581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.338858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.346032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.347526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:32.362170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:32.363261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:32.364382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:32.365204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 277/567] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:32.366041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.403497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c74287-c48a-450b-8220-188361bab9e7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.438716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.439536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.439820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.440097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.450338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:32.458751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:32.459872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:32.460863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 291/568] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:32.462052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.474325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103265e4-d572-4a31-b578-381e0bc83b6a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.489388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.510035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.510823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.511105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.511408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.521275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.522717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:32.540209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:32.541247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:32.542300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:32.542300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:32.542300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:32.542300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:32.542300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 278/569] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:32.542606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.567620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484ef-e6ad-4965-99a6-f81c9e6a9f23 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.572053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.601635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.602414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.602694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.602971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.613735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.615177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-5a21100a-cfad-44ad-bf38-32ed007304c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:32.631850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:32.632896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:32.633938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:32.633938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:32.633938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:32.633938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:32.633938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 292/570] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:32.634554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de869-4d8c-44d8-b1cf-c158026a9788 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.634554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de869-4d8c-44d8-b1cf-c158026a9788 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.634712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1de869-4d8c-44d8-b1cf-c158026a9788 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.636229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 293/571] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:32.636931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de869-4d8c-44d8-b1cf-c158026a9788 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.646250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0279f-60a9-4dbc-87d5-ac11181e60b3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.679035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.679802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.680084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.680357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.681138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.681445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.682872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.694474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 279/572] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.695262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.716373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.739715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1de869-4d8c-44d8-b1cf-c158026a9788 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.772504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.773161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.773440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.773709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.774448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.774750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.776151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.788747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 294/573] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.788747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.790068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.801255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0267e-0709-47b9-a916-a768e40395b4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.838692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.839372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.839656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.839927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.840638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.840941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.842313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821a59d-434f-403c-ab04-3edc4a3af806 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.853813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 280/574] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.855008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.855296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.855618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.872354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:32.873547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:32.890398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a5522-38d9-43ab-85c9-ef5822e9b59c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:32.923802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:32.924453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:32.924736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:32.925006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:32.925706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:32.926008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:32.927414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:32.935351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:32.938467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 281/575] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:32.939092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 295/576] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:32.939922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:32.940386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.026523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.038357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fb266-d73f-4ab6-bb0d-b1e93b1feca3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.044831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100765ae-c4d8-4ce9-a2d4-5f30596f494f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.071728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.072520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.072802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.073082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.078322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.078963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.079243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.079555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.080377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=497f17edb85d4ed999f24690f5bc0ff1) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:33.080682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.082096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.084053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.085486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.087403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 282/577] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/role_assignments?user.id=497f17edb85d4ed999f24690f5bc0ff1&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:33.088175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:33.106835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:33.107834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:33.108724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:33.108724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:33.108724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:33.108724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:33.108724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 296/578] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:33.109545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.181020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.203751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f35538-4c13-4ac8-b089-b164dad50a2a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.236365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388dc00e-b367-4463-9560-c9fd096d281d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.242020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.242824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.243107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.243418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.251853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.253365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:33.268312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:33.269244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:33.270163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 283/579] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:33.270730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.278417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.279144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.279459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.279734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.280589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.286782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.288445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:33.302908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:33.303824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:33.304673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 297/580] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:33.305137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.377515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b6990-f1b4-4489-81aa-3b3f7aea5028 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.409185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30207d2-0342-4a92-bf87-ea627056fcaf None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.411750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.412547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.412831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.413109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.423719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:33.424372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:33.431743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:33.432687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:33.433494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 284/581] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:33.434179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.453432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.454118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.454402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.454676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.455418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:33.455725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.457094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.472920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 298/582] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:33.472920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.505605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.541459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4783fd-9b26-4b62-8ef3-9efac0461aad None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.577332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.578071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.578359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.578657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.579520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:33.579836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.581291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.582582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd0583-5527-4dae-8c11-54aa644724d2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.599284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 285/583] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:33.600134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.623294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.623985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.624814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.625101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.625886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:33.626320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.627650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.646645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 299/584] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:33.647396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.679931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.710805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe24afb-04da-4ddd-bf05-a9d165b33e3f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.734893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.746147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.746812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.747097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.747394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.748142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:33.748448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.750378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.758139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfb69b-db0a-4aa3-8314-51827a4349b7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.762721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 286/585] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:33.762721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.805534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.806577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.807033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.807585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.816270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.817708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:33.832618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:33.833596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 300/586] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:33.834564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.875181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd215e-992d-415f-94a9-9c43bf4797f8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.910296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.911205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.911515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.911837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.924406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:33.925985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:33.932422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.941748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fd3a0-6596-4cf3-836f-396587575930 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:33.944808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:33.945694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:33.946565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:33.946565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:33.946565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:33.946565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:33.946565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 287/587] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:33.947248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:33.981008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:33.981894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:33.982179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:33.982460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/943294440c3a4d309ff6e6165dcb9d32/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:33.988539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:33.999162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=943294440c3a4d309ff6e6165dcb9d32, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.001298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.016122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 301/588] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:33 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/943294440c3a4d309ff6e6165dcb9d32/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:34.017212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.074759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841cc1f-b108-4d11-b584-4d1fb9271a21 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.116628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.117894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.118468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.118956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.131960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.133782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:34.154098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:34.155055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:34.156612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:34.156612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:34.156612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:34.156612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:34.163060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6fedf-1f12-4132-81c9-c803a28d26c7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.163688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 288/589] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:34.164453 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.202207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.203465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.203755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.204030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.204882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:34.205189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.206656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.225411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:34.234947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 302/590] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:34.236176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.284703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:34.297696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0a7f66-d56e-4a66-83e8-1c3399caee23 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.343931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.344521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.344834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.345519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.346267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:34.346834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.348508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.364446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 289/591] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:34.367551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.375441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74936cac-4886-415f-b4ca-cc28b81cb18c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.416030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.416775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.416981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.417260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.418001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:34.418279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.419684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.436157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 303/592] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:34.436157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.485046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b0234-8441-44bc-8ba7-8ec34038f337 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.494758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:34.523121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.524148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.524533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.525007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.543358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.543358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.549041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb272aa-4cdf-4586-9dd8-5a01fb602456 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:34.556208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:34.557280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:34.558360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:34.558360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:34.558360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:34.558360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:34.564815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 290/593] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:34.565772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.568731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:34.592057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.593158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.593693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.594188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.601903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.603535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:34.618955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:34.620031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:34.621063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:34.623359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 304/594] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:34.624929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.675161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52825711-4c9d-436a-a773-e1e106adbab5 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.710637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.711645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.712032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.712414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.721038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.722925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.735605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86257b75-6150-4ea4-a963-53ed22aadbfc None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:34.737696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:34.738786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 13:34:34.739995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:34.746282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 291/595] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:34.747400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.761681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:34.779559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.780647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.781175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.781589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.782464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:34.782930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.784594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.799889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 305/596] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:34.801000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.827161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:34.868942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b93a-6c5b-449a-9831-02daaa68812f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.904276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.905087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.905519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.905993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.906830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:34.907221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.908796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.915469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbde11-e766-41be-a7fb-9724c612f472 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:34.922201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 292/597] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:34.923219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:34.954099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:34.955097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:34.955556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:34.956021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:34.957059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:34.957547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:34.959454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:34.978662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 306/598] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:34.979835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.023683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.029954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806abb69-6361-4d64-9432-551dfc6693d4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.053990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.066976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.067678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.067967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.068240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.075370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.076807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:35.090908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:35.091860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:35.092727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:35.097015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 293/599] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:35.097909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.098383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df26b83-029f-48b1-9f36-e9036a62f42a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.136684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.137496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.137780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.138058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/695790c0f33f40e1a0ea7e70318d419a/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.153104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=695790c0f33f40e1a0ea7e70318d419a, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.154768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.168482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 307/600] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:34 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/695790c0f33f40e1a0ea7e70318d419a/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:35.169665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.218503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246778f0-7fcc-4c91-89ff-2cb17c65ecb1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.265174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.265995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.266285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.266547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.282443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.283675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.285527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.301263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb7c28-df3e-4dac-9daa-22a6516effaf None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-694761d8-e2f5-4f27-9df8-1c72f3f5f547 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:35.311619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:35.312619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 294/601] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f96962-fbc5-47a4-8db1-ffe52bd7eb6e None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f96962-fbc5-47a4-8db1-ffe52bd7eb6e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.318076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f96962-fbc5-47a4-8db1-ffe52bd7eb6e None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.321339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 295/602] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:35.322250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f96962-fbc5-47a4-8db1-ffe52bd7eb6e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.359866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.360537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.360908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.361102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.361911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:35.362205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.364182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe210-d567-4939-999e-a4066fc8943e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.374072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.377018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 308/603] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:35.378169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.378463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.378746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.406055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:35.407189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:35.460959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f96962-fbc5-47a4-8db1-ffe52bd7eb6e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.488643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 309/604] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:35.495431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.509044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.509813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.510153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.510432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.511216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:35.511841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.514487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.532512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 296/605] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:35.534378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.599852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.634203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5797ede-2f22-4ff5-a6a6-fe6b3143dce9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.654810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.662684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b3806-8528-435a-b82f-df513d966bd8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.684734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.686133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.686588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.687307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/e9625fcd053644e3914df6762e067788/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.699163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.700147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.700530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.700910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.707238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=e9625fcd053644e3914df6762e067788, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.708773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.713141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:35.722694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:35.723845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:35.724894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:35.727048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 297/606] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:35.727804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.734275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 310/607] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:35 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/e9625fcd053644e3914df6762e067788/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:35.735758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:35.870083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb9413-9d9b-405f-81b7-f7942e0bb396 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.903126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:35.906760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c5195-e671-48b0-a709-007fef8e8ae0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:35.920160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:35.920767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:35.921047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:35.921320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:35.929530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:35.929938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:35.931471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:35.942344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 311/608] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:35.948765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.001978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.002971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.003384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.003669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.011567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.013020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:36.029588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:36.033716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:36.034596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 298/609] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:36.041073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.058341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:36.070794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b36e2eb-c63b-4d60-bb9c-14afce5c40cb None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.114686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.115789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.116069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.116927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.131356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.132837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.156794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f69215-0da1-498a-b81a-b1addf675f10 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:36.157575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:36.158881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:36.160051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:36.160051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:36.160051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:36.160051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:36.163416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 312/610] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:36.165899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.200766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.201070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.201267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.201557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.202890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:36.203205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.204693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c362c-bdba-421b-aac0-663eb31e53bc None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.222673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 299/611] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:36.223772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:36.225240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64482-c838-41e6-8a0d-15b4eac6b3ac None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.225732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64482-c838-41e6-8a0d-15b4eac6b3ac None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.226361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d64482-c838-41e6-8a0d-15b4eac6b3ac None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.229096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 300/612] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:36.230223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64482-c838-41e6-8a0d-15b4eac6b3ac None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.303399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe52959-58cb-4d19-b635-1d38be66cf94 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.310411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:36.340258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d64482-c838-41e6-8a0d-15b4eac6b3ac None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.348105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.348781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.349066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.349382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.350447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:36.350567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.351960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656e3bd-77d4-442e-971e-5f2215158be7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.370125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 313/613] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:36.370125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.370125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.370125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.386946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:36.387844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.388307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:36.389325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.390430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.391477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/f0dd5d8814384b14b46e8e6fd4fab9f6/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.411047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=f0dd5d8814384b14b46e8e6fd4fab9f6, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.413665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.432363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 301/614] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:36 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/f0dd5d8814384b14b46e8e6fd4fab9f6/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:36.433549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.471781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 314/615] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:36.503447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.568804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d138e0-fdb9-40fa-82ec-ec08ed3401d8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.597147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:36.604478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:36.625150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.626273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.626706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.627127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] PATH_INFO: `/v3/users/swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.635747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.637456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:36.656102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:36.657130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:36.658288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:36.660593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 302/616] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:36.665849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.705841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f1880-ee47-4812-9c6b-14cc55790635 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.751056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.751822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.752112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.752615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.776579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57a34c-0c31-4eb0-bc92-d8f2b42d082b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:36.792179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:36.813468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:36.814536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:36.815791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 315/617] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:36.820569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.821975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:36.822815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:36.823245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:36.823690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:36.824706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:36.825217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:36.826852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:36.846962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 303/618] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:36.853333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:36.937124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.007070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.016978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97656bfb-c773-400f-a2e8-45c1ee81e12d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.038157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13de99f-2c87-45e3-abb7-66aa606f69a2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.075135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.076225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.076759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.077189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.088758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.090415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.100923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.101607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.101894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.102174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.102926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:37.103234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.104634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:37.109921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:37.111084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:37.112173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:37.112173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:37.112173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:37.112173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:37.114064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 304/619] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:37.120070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 316/620] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:37.121133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.124847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.220662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.227720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02b2e5-bbff-4cde-b1f2-ee46de3e5b3d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.266414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.267500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.267994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.268472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.269392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:37.269900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.271511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.284111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 305/621] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:37.290210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.325456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898acabf-b76b-42b4-8e97-ea119878d497 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.396095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.396905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.397195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.397476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.428218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.429698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.442974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb60b74-1966-46be-b96a-e29cf223c21d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:37.472215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:37.473143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:37.474681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:37.474681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:37.474681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:37.474681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:37.474681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 317/622] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:37.478914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.491440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.492527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.493035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.493524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.503912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.507035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.508586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:37.523608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:37.524501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:37.525388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 306/623] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:37.533019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.559472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.638409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b128dff-2d37-492c-a6c3-0044f5692576 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.676779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb0dc08-8ff8-4ef6-b177-cd12e01bc4c1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.679815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.680486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.680771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.681041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.681769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:37.682080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.683485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac585287-bb79-4fad-9cdd-0c212dc6226d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.696096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 318/624] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:37.697372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237081a2-9010-48b7-8bec-e5c3e52a090c None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.697826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237081a2-9010-48b7-8bec-e5c3e52a090c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.698125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237081a2-9010-48b7-8bec-e5c3e52a090c None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.703468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 319/625] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:37.704263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237081a2-9010-48b7-8bec-e5c3e52a090c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.717538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.719207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.719663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.720086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.721721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:37.722211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.724346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87e506-eb64-4658-9f21-26de4ec0886f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.741466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 307/626] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:37.744604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.745222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.745829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.768095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:37.770331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:37.778214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.826270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237081a2-9010-48b7-8bec-e5c3e52a090c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:37.862793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 308/627] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:37.864061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.872699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:37.873515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:37.873814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:37.874135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:37.881869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:37.886852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:37.887416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:37.913875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:37.914929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 320/628] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:37.916959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:37.975393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1325c-f657-461a-890c-316ca173eda2 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.011308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.012664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.013188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.013666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/497f17edb85d4ed999f24690f5bc0ff1/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.024817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c329c54c-a643-4246-9657-3d74758ff3e4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.031237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=497f17edb85d4ed999f24690f5bc0ff1, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.033156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.048313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 309/629] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:37 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/497f17edb85d4ed999f24690f5bc0ff1/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:38.049455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.053756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.072248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.073080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.073371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.073706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.104286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:38.112418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:38.113448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:38.114302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:38.119853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 321/630] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:38.125245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.125899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.189861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b2784-d949-4136-b61b-a9c77b80dd8f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.230141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.231171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.231709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.232249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.233602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:38.234137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.235926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.254969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 310/631] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:38.262843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.285303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b699a62-1ba2-438d-8846-8f0d98625121 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.331898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.332951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.333491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.333963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.334906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:38.335470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.337046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.351851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 322/632] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:38.356861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.377026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de1e1-11c4-437a-951d-3d8337062994 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.391575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.422935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.425724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77179b8d-eed4-491d-a65c-2c424148cb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.426653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179b8d-eed4-491d-a65c-2c424148cb67 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.426941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179b8d-eed4-491d-a65c-2c424148cb67 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.427220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179b8d-eed4-491d-a65c-2c424148cb67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.480374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a901b3-e773-4616-9865-f5caf008ed46 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.518276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.519996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.520438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.520860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.536294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.537501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77179b8d-eed4-491d-a65c-2c424148cb67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.537973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.539416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77179b8d-eed4-491d-a65c-2c424148cb67 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-638031dd-5b4a-4757-a3f0-3e8e1b3044cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:38.565399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:38.566341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:38.567203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:38.567203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:38.567203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:38.567203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:38.567203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 323/633] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:38.568516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37c1b-03b5-42c9-adb9-d3f1587195c6 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.568918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37c1b-03b5-42c9-adb9-d3f1587195c6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.569202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a37c1b-03b5-42c9-adb9-d3f1587195c6 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.570802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 324/634] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:38.572183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37c1b-03b5-42c9-adb9-d3f1587195c6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.669618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 311/635] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:38.672826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d088f-a961-4cce-8ded-d48bf81953e0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.673435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d088f-a961-4cce-8ded-d48bf81953e0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.673918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d088f-a961-4cce-8ded-d48bf81953e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.690564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c33d088f-a961-4cce-8ded-d48bf81953e0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:38.692583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c33d088f-a961-4cce-8ded-d48bf81953e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:38.700964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.707618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.713957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a37c1b-03b5-42c9-adb9-d3f1587195c6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.751740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.752731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.753014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.753287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.754000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:38.754662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.755690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.767788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 325/636] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:38.768392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.774095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 312/637] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:38.774095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4b86-7f58-4910-954c-ecb78b4f7040 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.774095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4b86-7f58-4910-954c-ecb78b4f7040 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.774095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd4b86-7f58-4910-954c-ecb78b4f7040 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.774095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 313/638] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:38.774095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4b86-7f58-4910-954c-ecb78b4f7040 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.886107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a96c9-f361-4018-8f2f-84e8b9ddec9d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.892690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd4b86-7f58-4910-954c-ecb78b4f7040 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:38.921928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.922744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.923033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.923340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.928710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:38.929769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.930251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.930818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.934986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.936480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.940396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:38.941826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:38.955893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:38.956904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:38.957776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:38.957776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:38.957776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:38.957776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ede7441d-1b79-48fe-85db-e51a4225ca6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:38.958586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:38.959475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 314/639] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:38.960436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:38.961145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:38.962504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 326/640] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:38.963580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:38.969571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.980702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:38.981792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:38.982703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:39.055503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 315/641] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:39.055503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.077410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356542-12d2-4dd1-81e7-f92bdc264f0b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.112610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.113399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.113682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.113957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.127751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:39.135465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:39.136586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 327/642] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:39.137419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.174230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7a0b5-f35b-4760-b592-f6e2af0faef7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.205801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.211175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.211966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.212251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.212524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.213612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:39.213919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.215370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.217612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.235394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 316/643] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:39.236412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.259102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf088-268b-498d-87da-2f23ffc70865 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.297901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.298562 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.298849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.299133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.299881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:39.300184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.301559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.314034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 328/644] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:39.314889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.349684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca744c2a-ef1f-4db1-baee-8ec73ff50178 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.386535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.387347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.387639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.387915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.399784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:39.408139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:39.409036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:39.409919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 317/645] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:39.410715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.427327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef6ef5-d961-4edc-a348-ef7012754d39 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.458244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.464386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.464912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.465197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.465472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.466215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:39.466525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.468799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.472490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.477867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 329/646] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:39.478399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.533128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27e51b-2781-4c62-acac-28cecdaa6c57 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.568301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.569345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.569642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.569920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.582680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4204b36-3bf3-449b-8522-bdbada4e68ef None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.618769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.619513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.619799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.620077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.626932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.628395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:39.643133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:39.644165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:39.645110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 330/647] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:39.645589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.646097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.647607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.698644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.710938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.751832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 318/648] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:39.752885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.763230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7aaa7-bdfb-4190-8f22-5b8af52ef873 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.802155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.802939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.803332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.803704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.804522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:39.804900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.806408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.820460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 331/649] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:39.821427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.862444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68fbf-2720-4113-89c9-5ac0d3015687 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.898813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.899611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.899917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.900195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.910597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.912073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.926890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc95754-8a41-474c-a61b-1d9e88abe9f8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:39.929407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:39.930270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:39.931129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:39.931129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:39.931129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:39.931129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:39.931129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 319/650] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:39.931735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:39.937778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.951509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:39.971869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:39.972531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:39.972813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:39.973085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:39.973862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:39.974166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:39.975623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:39.992773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 332/651] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:39.992773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.045365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59bac8-e287-4c4c-a22b-d0f1e1d72ab2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.079675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.080468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.080756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.081032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.091839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.093338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.097947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c17564-a966-490c-9c90-df798b8e9b70 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:40.110406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:40.111305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:40.112298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:40.112298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:40.112298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:40.112298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:40.112298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 320/652] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:40.113141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.137760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.138565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.138834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.139107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.150795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.152331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.166729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:40.172643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:40.173683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:40.174632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:40.174632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:40.174632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:40.174632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:40.174632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 333/653] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:40.174632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.203469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.219990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec09b0-91d0-4544-8713-54568cc295e4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.253984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.254643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.254924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.255197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.255949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:40.256254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.257646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.269188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 321/654] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:40.270097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.284833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7791c-42e1-44b6-b7be-f2a077a4b2ad None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.318844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.319518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.319802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.320078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.320901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=943294440c3a4d309ff6e6165dcb9d32) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:40.321210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.322637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.328461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 334/655] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/role_assignments?user.id=943294440c3a4d309ff6e6165dcb9d32&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:40.329235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.369823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa30bb-29e4-4650-b677-e80e966ace7b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.385503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.409862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.410971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.411507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.411973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.413010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:40.413516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.415202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d071ff8-5ce1-415c-b515-8683b9896590 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.427970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.435735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 322/656] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:40.437297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f300076-3098-44d3-a99a-e8083db110d9 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.438522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f530e-8b7d-422c-9333-6e334ef2e729 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.438970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f530e-8b7d-422c-9333-6e334ef2e729 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.439954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f530e-8b7d-422c-9333-6e334ef2e729 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.442002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 323/657] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:40.443044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f530e-8b7d-422c-9333-6e334ef2e729 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.474752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.475679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.476083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.476362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.477088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:40.477399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.478818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.492133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 335/658] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:40.492983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.564448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f530e-8b7d-422c-9333-6e334ef2e729 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.601121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.602173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.602454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.602726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.603561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c0d4f-3892-46de-ba84-7ba5cb2a0c92 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.612396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.614317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-3ce98189-7406-4ade-9958-07d4ee46ce5e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:40.634800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:40.635798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:40.636733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 324/659] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:40.637990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.637990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.638127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.644235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.646037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.646331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.646613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.654719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.656229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.656348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:40.657407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:40.671761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:40.672802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:40.673844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:40.675627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 336/660] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:40.676560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.689097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.695874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.737513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 325/661] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:40.738364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.797281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acdd10-c8eb-49cc-876d-b9049e722e20 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.835028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.836111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.836569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.836851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.844984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.846440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:40.860935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:40.861988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:40.862992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 337/662] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:40.863889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.868722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f1236-0648-4489-aa0c-3f3ad57e4d9c None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:40.907603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:40.908642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:40.908931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:40.909211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:40.910809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:40.911131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:40.912832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:40.935446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 326/663] 10.222.0.25 () {56 vars in 1137 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:40.935446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:40.944118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.966089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:40.978239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dee63-2792-490d-8de7-54d5fe5663c5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.014432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.015128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.015453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.015779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.016583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:41.016895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.018751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.032412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 338/664] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:41.033218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.049517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bd35a-ee3a-440f-a412-df023a2638d3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.087183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.088103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.088642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.088921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.099981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:41.108224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:41.109678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:41.110514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 327/665] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:41.111819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.140835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc5005-e517-464f-b3d4-7f0870fc33a8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.170601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:41.178062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.178728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.179034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.179311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.180162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:41.180469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.181899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.197739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:41.204273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 339/666] 10.222.0.25 () {56 vars in 1139 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:41.204273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.225287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05992c25-44fa-4942-b22b-205dfc8f0357 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.262179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.262835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.263124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.263428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.304707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c6c39-4630-47b3-b171-00b8228e3b9d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.336158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.337605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.341507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.342157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.342438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.343223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.344072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=695790c0f33f40e1a0ea7e70318d419a) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:41.344385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.346142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.352161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 340/667] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/role_assignments?user.id=695790c0f33f40e1a0ea7e70318d419a&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:41.352938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.428936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:41.463899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:41.486514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b289667-5a9e-4d39-ab10-f6f5d0170293 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.491917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 328/668] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:41.493208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.527360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.528905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.528905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.528905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.529701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:41.530104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.532125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.541420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 341/669] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:41.542599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.627890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd675f-7ca2-4b24-92f3-6858800c8b5f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.662424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01e029-7607-402b-a493-11eebccdd96f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.674903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.675922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.676360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.677040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.680682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:41.701507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.702948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.703461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.703811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.716498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.718590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:41.737297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:41.738444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:41.739597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:41.739597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:41.739597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:41.739597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:41.741222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 342/670] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:41.742099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.744811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:41.772920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.775049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.861495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc128a-b1a0-48f2-ada4-ba98555fd283 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:41.902183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:41.902977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:41.903259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:41.903578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:41.913683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 329/671] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:41.914991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.916645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:41.918263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:41.940374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:41.941304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:41.942191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:41.942191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:41.942191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:41.942191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:41.942191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 343/672] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:41.943064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:41.966397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.020706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.043748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b77a9-5606-4622-9dea-1fae931cd71d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.068429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf028b-a43d-46bc-9f37-f9bdfd938f74 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.088033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.089019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.089565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.089853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.090639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:42.090958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.092840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.107432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 330/673] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:42.108697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.116447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.117530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.118011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.118973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.133554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.136116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:42.160910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:42.161842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:42.162707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:42.162707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:42.162707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:42.162707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:42.169805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 344/674] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:42.169805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.227927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9dccdd-30a2-4d44-aeca-8296d6c63771 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.241524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.267469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.268508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.268990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.269481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.270966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:42.271517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.273072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.273854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706bd25-b9eb-45a5-9987-0279b32c3d20 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.286134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 331/675] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:42.287194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.289908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.314256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.315118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.315450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.315732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.323142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.324642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:42.340417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:42.341332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:42.342205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 345/676] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:42.343686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.401614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60032c-3218-4cc4-912a-4eee5c793a2f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.446659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.447363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.447638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.447914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.448640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:42.448951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.450321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.454626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201166a-1d35-4089-85ea-0b2cae48192e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.462704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 332/677] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:42.463982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.488291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.494505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.495295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.495609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.495884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.503280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.504769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:42.519699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:42.520838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 346/678] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:42.526366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.532431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.573394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f55586-761d-433c-a6d5-8e63b8cdbec9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.609192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.609943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.610297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.610635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.611519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:42.611897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.613380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63907e65-8a94-47e9-bb4c-198b69cd3a92 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.630640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 333/679] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:42.630640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79465802-98d0-4b97-b040-e4d822c5ace5 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.630640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79465802-98d0-4b97-b040-e4d822c5ace5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.630640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79465802-98d0-4b97-b040-e4d822c5ace5 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.630640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 334/680] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:42.630640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79465802-98d0-4b97-b040-e4d822c5ace5 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.640968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cb7a4-0e05-43a2-9c78-a5b98358ce91 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.675641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.676436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.676725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.677002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.683762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.685213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:42.699301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:42.700203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:42.701113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 347/681] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:42.701680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.748626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79465802-98d0-4b97-b040-e4d822c5ace5 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.758838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.778482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:42.794529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.795362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.795743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.796682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.797581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:42.797960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.799516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b69d-c4c0-4155-a245-bff381da4f31 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.817617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 335/682] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:42.818736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77775f-607e-4ed2-b850-28a0d7c6f141 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:42.819216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.819677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.820100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.836866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:42.838474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:42.860694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:42.861544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:42.861980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:42.862399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:42.863415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=e9625fcd053644e3914df6762e067788) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:42.863726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:42.865166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:42.875464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 348/683] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/role_assignments?user.id=e9625fcd053644e3914df6762e067788&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:42.875464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:42.934006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 336/684] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:42.935073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.026122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e1e46-049b-4f74-8ab5-da46f9bcd7cd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.044616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.058006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920480b-b664-4c5e-9e4b-81fea2d9565f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.065757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.066549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.066940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.067376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.068240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:43.068622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.070141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.071202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.088848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 349/685] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:43.089694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.104658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.105316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.105596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.105867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.181594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.183046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.217161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d60d8e-e94e-427d-b2f5-04ce7addcc3e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.253716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.254511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.254792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.255067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.267497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:43.275586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:43.276498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:43.277307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 350/686] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:43.277989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.302106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 337/687] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:43.302921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.319293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.325924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.398416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4156-631c-4d48-a0dc-cdd721fb98ca None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.411438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdf9d-418f-4f2d-9673-84c51563788b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.434415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.435068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.435359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.435640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.436506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=f0dd5d8814384b14b46e8e6fd4fab9f6) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:43.436820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.438256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.444671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 351/688] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/role_assignments?user.id=f0dd5d8814384b14b46e8e6fd4fab9f6&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:43.445483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.453391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.454136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.454423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.454697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.455499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:43.455811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.457246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.480545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 338/689] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:43.486836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.578775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.599807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.605563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06c28b-17fa-4cce-82dc-555b9d045eca None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.618498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c99ee-7b74-49fe-93af-22fd456606cd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.651789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.652598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.652887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.653167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.659678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.660521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.660805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.661086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.666748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.668375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.671607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.673046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-6d88e2c7-98be-4a3a-b264-aa1c2129ab70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:43.687466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:43.688726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:43.689619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:43.689619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:43.689619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:43.689619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:43.692353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:43.693223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:43.694126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:43.694126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:43.694126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:43.694126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:43.694366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 352/690] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:43.694438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 339/691] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:43.694669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f66a6-b711-43b2-9c8a-4859945f1b36 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.695045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f66a6-b711-43b2-9c8a-4859945f1b36 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.695191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f66a6-b711-43b2-9c8a-4859945f1b36 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.697233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 353/692] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:43.701334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.704395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f66a6-b711-43b2-9c8a-4859945f1b36 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.812212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d18c3d-1ea2-4245-b2e6-2485c06b4c84 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.813909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f66a6-b711-43b2-9c8a-4859945f1b36 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:43.849531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.850564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.850892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:43.851285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.851599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.851884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.852160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.852404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.852885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:43.853195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.853745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:43.854243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:43.854562 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab897-9ecb-410c-b4dc-44847d75094a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.856137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:43.866216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.874578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 354/694] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:43.874578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:43.874578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:43.874578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:43.875372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 340/694] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:43.876448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.891894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:43.893191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:43.900902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:43.965397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 355/695] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:43.966437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:43.984643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983d1c34-4ba8-414d-839d-45d52d0b24af None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.021135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.022547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.023093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.023745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.031906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:44.048962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:44.049871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:44.050732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:44.053333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 341/696] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:44.054414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.073992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf584e-e0bd-4f24-814a-66ea36c86038 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.108811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.109722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.109831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.110101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.112555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.118596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.120183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:44.135487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:44.136450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:44.137353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 356/697] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:34:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:44.137943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.145380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.178103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031aea3-944f-40be-be93-2644e9896f05 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.215632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.216716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.217174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.217549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.218356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.219859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:44.235703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:44.236828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:44.237692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:44.238462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 342/698] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:44.239107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.253476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da326780-bb26-4f4d-9e92-e3cd9f2d7f42 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.288585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.289258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.289547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.289826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.290622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:44.290925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.292410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.309721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 357/699] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:44.309721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.368047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04881daf-3418-49d6-89c8-c77f82dc501a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.377996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.380679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.418539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.419481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.419779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.420063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.421846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:44.422165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.423930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.424899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41ecaa-779b-4d41-bc45-03336994d14c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.443207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 343/700] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:44.444382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.476580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.477282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.477570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.478107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.478826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:44.479139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.481233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.492555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 358/701] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:44.492555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.567232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a44df-1edf-46db-b6ad-1c34d4b8baba None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.603610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.604731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.605230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.605713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.606780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=497f17edb85d4ed999f24690f5bc0ff1) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:44.607307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.609511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.622423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac50f9b-83cb-42c7-b227-947a0b466518 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.623187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 344/702] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/role_assignments?user.id=497f17edb85d4ed999f24690f5bc0ff1&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:44.624432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.654659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.667264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.668682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.669122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.669543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.707716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.756209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.758639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.885378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 359/703] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:44.886746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:44.887705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079c078-f5d2-48ba-9d9b-3570d4392b43 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:44.920527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:44.936689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:44.937369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:44.937694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:44.938470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:44.939194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:44.939552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:44.941379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:44.950473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 345/704] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:45.016078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630deab-7700-45d6-a59c-5be081e402cd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.055432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.056245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.056531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.056810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.069251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.070730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-06640a23-8c16-49f5-aa02-ffa4957f6e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:45.091789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:45.093959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:45.095693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:45.095693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:45.095693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:45.095693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:45.095693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 360/705] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:45.098917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.161787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfca08-faa0-443f-9fb6-39271460d279 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.162080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfca08-faa0-443f-9fb6-39271460d279 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.162428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfca08-faa0-443f-9fb6-39271460d279 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.164161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 361/706] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:45.169275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.169639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.169994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.197393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:45.198911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:45.215201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:45.223338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac6c1-b125-4830-829f-69466108e130 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.266612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.267571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.267860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.268139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.268871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:45.269181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.271109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.278754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 362/707] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:45.291351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 346/708] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:45.292933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.304672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.308081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:45.402189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505b04ee-7a4e-4c8e-ab6e-5b0c6f36c506 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.427221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a9b20-50a1-4870-bc72-59e43c77237e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.445752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.446564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.447061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.447350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.460157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.461632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:45.488342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:45.489268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:45.490167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:45.490593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.491190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.492268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.492268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.492666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 363/709] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:45.498322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.514847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.516397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:45.545440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:45.546948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:45.547877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:45.547877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:45.547877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:45.547877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:45.552518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 347/710] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:45.556598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.575678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:45.617082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:45.654528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfceff-fd6b-4034-9805-0a088a9040a2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.691442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.692269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.692663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.693052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.693954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:45.694374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.696213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ad552-d2df-4302-ac4f-36e44c730e6a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.711065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 364/711] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:45.715305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab70fe-bedf-4fcc-9b93-3d08ce2682f1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.715619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab70fe-bedf-4fcc-9b93-3d08ce2682f1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.715899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab70fe-bedf-4fcc-9b93-3d08ce2682f1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.717278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 365/712] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:45.719069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab70fe-bedf-4fcc-9b93-3d08ce2682f1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.757859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b8306-b83f-4509-b71d-8ea3d9a9c65d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.794247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.794932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.795207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.795515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.796281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:45.796600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.797976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea913e48-8d1e-4e63-b129-9ef6d66bab4f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.822452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 348/713] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:45.822452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.822452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.822452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.842727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:45.844815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:45.870953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab70fe-bedf-4fcc-9b93-3d08ce2682f1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:45.912580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:45.925355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:45.926249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:45.928488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:45.929194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:45.929714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:45.932000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=943294440c3a4d309ff6e6165dcb9d32) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:45.932467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:45.934543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:45.935959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 349/714] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:45.937967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:45.943423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 366/715] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/role_assignments?user.id=943294440c3a4d309ff6e6165dcb9d32&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:45.975937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:46.066115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555a7d0-134f-468e-83fb-9644f2b5a64c None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:46.109644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:46.110329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:46.110608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:46.110879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:46.111613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:46.113042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:46.143179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 350/716] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:34:45 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:46.172499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801dc017-2146-4923-b6db-e18a7aeef83b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:46.215345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:46.216085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:46.216375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:46.216655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] PATH_INFO: `/v3/services/network` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:46.217322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:46.218766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:46.238618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:46.239766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:46.240599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:46.244380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 367/717] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:45 2022] GET /identity/v3/services/network => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:46.250588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:46.338705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:46.397896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab4f8d-4df2-4b1d-a497-b9578b8ccabf None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:46.436951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:46.437618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:46.437900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:46.438173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:46.438885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] RBAC: Adding query filter params (name=network) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:46.439191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:46.440591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5befb1-0c6a-4551-be43-fd167274ceaf None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:46.446036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 351/718] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:34:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:46.451463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:46.516062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:46.566756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed725e7d-55eb-4aed-aeed-ee328e7cb5cc None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:46.602763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:46.603837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:46.604325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:46.604810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:46.605730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] RBAC: Adding query filter params (type=network) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:46.606231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:46.607835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f81a0-f525-4b45-8723-8c5cca573acf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:46.616189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 368/719] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:34:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:47.386347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fc194-55d0-439a-b015-97ad53b7d56f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:47.386862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fc194-55d0-439a-b015-97ad53b7d56f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:47.386937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701fc194-55d0-439a-b015-97ad53b7d56f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:47.388517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 352/720] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:47.394711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:47.395607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:47.396093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:47.413340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:47.414870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:47.450717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a198b-d2a0-46b8-a954-e90f9ced265f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:47.451387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a198b-d2a0-46b8-a954-e90f9ced265f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:47.452741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a198b-d2a0-46b8-a954-e90f9ced265f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:47.455505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 353/721] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:47.460447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:47.461407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:47.461913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:47.492458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:47.493684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:47.500165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 369/722] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:47.522693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:47.573751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:47.617994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 354/723] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 13:34:47.633575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb32de-35d6-4a72-94c0-6f31b6bddb1d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:47.661576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:47.668482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:47.669151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:47.669435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:47.669711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:47.670445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:47.672370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:47.705941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 370/724] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:34:47 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:47.721568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:47.822624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db6b06e-93d4-49a3-a59e-17e3eeb100c9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:47.889730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:47.890922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:47.891438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:47.891943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:47.909896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:47.917923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:47.918811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:47.919651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:47.922508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 355/725] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:47.929138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:48.046501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4822417-a9b4-47b1-bf2c-ddaf79f424ff None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:48.058871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:48.091432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:48.092175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.092494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.092831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:48.093592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:48.093905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:48.095298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47d16f-75b8-450a-b8bb-bceb36840cfe None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:48.104543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 371/726] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:48.110026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:48.254788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4caa5-c28c-4119-a794-8173d6b49136 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:48.256667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:48.312145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:48.313356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.313828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.314284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:48.334966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:48.336696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:48.397911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff0c9-a572-4e11-9619-8ea52570a4f3 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.398424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff0c9-a572-4e11-9619-8ea52570a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.398501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaff0c9-a572-4e11-9619-8ea52570a4f3 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:48.400283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 372/727] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:48.406038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.406328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.406613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:48.448571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:48.449829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:48.488278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:48.489591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:48.490483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:48.490483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:48.490483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:48.490483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:48.495410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 356/728] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:48.508391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:48.556595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 373/729] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:48.592009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:48.677131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889be156-fb43-4b46-afa9-abbbbd64e545 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:48.722523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:48.723193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.723508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.723786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:48.724522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:48.724832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:48.726218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:48.750571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 357/730] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:48.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:48.764059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca31a6b-4446-4f79-a043-2cecf776b82a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:48.766717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:48.779677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:48.829907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:48.830718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.830998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.831277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:48.853082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:48.872891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:48.874074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:48.874985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:48.876952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 374/731] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:48.882600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:48.920339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f8bb05-8e5f-4ddc-b89e-a755da70a4bd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:48.994873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:48.995955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:48.996418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:48.996843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.008761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.011793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:49.033678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:49.034865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:49.036043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:49.038213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 358/732] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:49.043294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.084261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd326ef0-caf1-4fd8-b7a9-b7e818f7202c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.122991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.123709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.124017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.124280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.125028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:49.125336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.126702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b022ed-1377-40d2-894c-6c68ca8a7422 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.138991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 375/733] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:49.138991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00054a-04d5-4909-9c71-e78c43e91545 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.138991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00054a-04d5-4909-9c71-e78c43e91545 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.138991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00054a-04d5-4909-9c71-e78c43e91545 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.138991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 376/734] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:49.139930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ec600-792a-4a21-b05f-58b641a3d6a2 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.140350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ec600-792a-4a21-b05f-58b641a3d6a2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.140452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ec600-792a-4a21-b05f-58b641a3d6a2 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.142138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 377/735] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:49.144098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ec600-792a-4a21-b05f-58b641a3d6a2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.149326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.172884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.179417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32655ded-01d9-4f8c-ae3c-7a6adfedff06 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.216643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.217301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.218128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.218413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.219453 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:49.220209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.221679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edafbae6-21ee-4bdf-8a11-1cdfee2fa41a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.239469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 359/736] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:49.240753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.241048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.241387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.257562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:49.258767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:49.260146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ec600-792a-4a21-b05f-58b641a3d6a2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.296162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.296887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.297169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.297452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.308841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.310295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d70eb687-9557-4f90-a087-92550840e954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:49.330165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:49.331058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:49.332034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:49.332034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:49.332034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:49.332034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:49.336622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 378/737] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:49.337936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.338629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.339053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.339581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 360/738] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:49.340813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.356986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:49.358247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:49.409358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.435510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 379/739] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 13:34:49.437251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.450470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.453433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f54b9-ebe4-4f59-958e-2677a04fa5d8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.489495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.490148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.490438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.490720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.557479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108a116-06a7-4a3a-b346-4f3c4493fbb2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.560554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.562577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.592927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.593591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.593917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.594443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.595178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:49.595688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.597974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.611665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 380/740] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:49.616951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.626590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.667774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 361/741] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 13:34:49.668896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.690410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.728010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cdc5e-78c1-4032-878d-16404b3391d0 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.761723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.762517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.762802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.763077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.773723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:49.774837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bea26-d998-42d7-99b9-fc4387042b12 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:49.781497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:49.782450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:49.783347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 381/742] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:49.787483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.820178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.820783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.821066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.821345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.822064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.823451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.842347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 362/743] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:34:49 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:49.843611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:49.897626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.914124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7adbb-1da0-4338-b599-2e4e9e091e21 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:49.944642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:49.960937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:49.961744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:49.962028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:49.962304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:49.971091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:49.972601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:49.996909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:49.997932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:49.999481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:50.003633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 382/744] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:50.004611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.007210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336bf46-02d6-4116-9291-8d5a155185fa None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.050735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.052032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.052581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.052922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.066305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.067086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:50.087532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:50.088905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:50.089978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:50.089978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:50.089978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:50.089978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:50.089978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 363/745] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:50.090657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.128676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52469b6e-bae8-4418-a7a8-1e1b58b3185f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.165089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.166065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.166547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.166962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:50.167821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.168784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:50.169242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.171620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.182656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 383/746] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:50.183732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.198798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bcbbf-c67d-4c48-a7a8-af47ac66ed0d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.234183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.235185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.235676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.236122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.236526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:50.237870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:50.238446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.240059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.261657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 364/747] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:50.266973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.307742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158f389-83c2-45ea-a003-cf241b20d546 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.355557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.356146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.356430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.356708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.357427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:50.357737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.360093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.378906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 384/748] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:50.378906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.383852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5281098-fc0e-452a-a03a-eb26503c4935 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.414308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:50.421629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.422883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.423171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.423491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.434687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.436183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ffea7636-a3d2-4afd-b675-8c8121c8c1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:50.454383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:50.455288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:50.456206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:50.456206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:50.456206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:50.456206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:50.460546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 365/749] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:50.462102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a897f-9305-43aa-acc7-c606805b2ed1 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.462397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a897f-9305-43aa-acc7-c606805b2ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.462680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a897f-9305-43aa-acc7-c606805b2ed1 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.464484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 366/750] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:50.465029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a897f-9305-43aa-acc7-c606805b2ed1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.490089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560a8d3-a29f-4023-9033-3b370f04c9b2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.493310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:50.529053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.530397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.530759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.531036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.541473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.542947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:50.562713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:50.563642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:50.565564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:50.565564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:50.565564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:50.565564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:50.565564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 385/751] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:50.569137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.572065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a897f-9305-43aa-acc7-c606805b2ed1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.610600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.611415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.611705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.611980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.620002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.621815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-183de02f-f6f4-44a8-9135-189f5924349b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:50.637606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:50.638513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:50.639920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 367/752] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:50.640939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.640939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.641108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.658844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:50.660077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:50.688821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab443ba-c061-48a2-a937-430e0a0a645e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.710173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:50.727167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.727867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.728154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.728424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.729156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:50.729446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.730877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.740859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 368/753] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:34:50.741696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.747227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 386/754] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:50.748306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.771940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:50.863385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72faea-5cfc-4691-b6dd-fa5e9977664e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.865179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c874aab-73d2-4ea5-8f70-ef2268339765 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:50.897813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.898470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.898755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.899059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.899863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:50.900176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.901618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.905951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:50.906611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:50.906889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:50.907161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:50.907906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:50.908217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:50.909557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:50.913468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 387/755] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:50.918915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.926332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 369/756] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:50.926332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:50.959734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.008417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.033333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9bd88-3a61-4519-97d5-97d00f240031 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.033884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b829c90-f9b8-4888-a4bd-3e792e30ad4d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.069432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.070382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.070738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.071009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.071140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.071869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.072151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.072422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.073093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.074513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.080489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.081951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:51.087561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:51.088752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:51.089659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 370/757] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:51.090501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:51.103090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:51.104090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:51.105029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 388/758] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:34:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:51.105604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.198181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.203135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c3093-75d5-4cab-918b-c3e88b5391d6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.210833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ad514-4a83-45a9-bd5f-7c2a607d4dc3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.239582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.240530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.241001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.241480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.242493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=497f17edb85d4ed999f24690f5bc0ff1) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:51.243006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.244298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.244847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.245077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.245363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.245641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.248362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.252853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 371/759] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/role_assignments?user.id=497f17edb85d4ed999f24690f5bc0ff1&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:51.252976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.254061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.254613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:51.279160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:51.280719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:51.281625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:51.285907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 389/760] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:51.286900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.386899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bda030-fbb3-4581-a462-c3f16a2000bd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.396033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa97c0-d666-4f59-85b7-cf8aa67d4327 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.437652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.438576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.438835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.439185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.439670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.439785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.440173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.440548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.440931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:51.441396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:51.441543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.441704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.443139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.443290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.449542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 372/761] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:51.450562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.469174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 390/762] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:51.470257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.489228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.568660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd31ee-da23-43ec-9f74-4bf23d82150d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.575734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.595871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb586f2-7dd4-4422-8949-763e849cdc99 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.607291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.608193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.608666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.608962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.609852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:51.610268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.611891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.630000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 373/763] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:51.631175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.637224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.638079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.638506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.638923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.640354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:51.640826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.642908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.650178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 391/764] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:51.651124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.732213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.749063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfdb7b-3967-4a44-8577-12d9f5ad9155 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.762460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed02fc90-bad1-4801-a1db-ef80654fda85 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:51.789504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd198916-06a8-4ba1-a07b-2268dad84f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.790157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198916-06a8-4ba1-a07b-2268dad84f3e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.790436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198916-06a8-4ba1-a07b-2268dad84f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.790886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:51.791886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd198916-06a8-4ba1-a07b-2268dad84f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.813638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:51.815060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:51.815609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:51.816248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/943294440c3a4d309ff6e6165dcb9d32/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:51.818778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=943294440c3a4d309ff6e6165dcb9d32, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.820946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:51.840259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 392/765] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:51 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/943294440c3a4d309ff6e6165dcb9d32/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:51.841401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:51.920631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd198916-06a8-4ba1-a07b-2268dad84f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:51.924226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd198916-06a8-4ba1-a07b-2268dad84f3e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.012489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa2e89-35c3-47f7-9e7c-ce06377585fb None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.032330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:52.053524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 374/766] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:34:52.056065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.056221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444401-51cf-4194-a5ce-ff32482e0af9 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.056695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444401-51cf-4194-a5ce-ff32482e0af9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.056865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.057258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.057497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444401-51cf-4194-a5ce-ff32482e0af9 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.057598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.058825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] RBAC: Adding query filter params (interface=public, service_id=35be7744ef3b489e85027b602c9e9791, region_id=RegionOne) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:52.059305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.059717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 375/767] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:52.060614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444401-51cf-4194-a5ce-ff32482e0af9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.063201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae3937-8a31-4543-a6cb-904c880ef405 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.074592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 393/768] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:34:51 2022] GET /identity/v3/endpoints?service_id=35be7744ef3b489e85027b602c9e9791&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:52.076257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.076552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.077388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.096740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:52.098078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:52.136823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:52.187241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444401-51cf-4194-a5ce-ff32482e0af9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.191555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 394/769] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:34:52.192661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.223781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.225029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.225385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.225774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.237752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.239642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:52.258162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:52.259090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:52.259980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:52.259980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:52.259980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:52.259980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:52.263466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 376/770] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:52.264380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.308506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:52.326471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22872b-af93-42e5-a814-64c186958dfd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.370338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.371904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.372370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.372843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.374257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.374548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498e81b-0479-4380-9bcc-a45bab4ba5a1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.376264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.383484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 395/771] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:52.384943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.433982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:52.441648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.442641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.442922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.443686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] PATH_INFO: `/v3/services/network` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.444030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.445509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:52.471941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:52.472992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:52.473817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:52.474531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 377/772] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:52.479408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.658254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cd177-e63b-47ef-94f1-62b0333b32e1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.695174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d6301-4b00-4bb4-9864-a2e2df2bb8bd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.696785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:52.704344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.705698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.706230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.707021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.708292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:52.709099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.710920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.727023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 396/773] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:52.733948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.741264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.741938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.742220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.742492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.743209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] RBAC: Adding query filter params (name=network) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:52.743556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.744923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.750121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 378/774] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:52.755217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.876300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:52.887755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c51dd-ab13-4b5a-8d3b-84790db6b62b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.898066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d864c43-f754-47c8-93aa-295b55788b4f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:52.929122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.930038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.931596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.932854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.933711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] RBAC: Adding query filter params (type=network) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:52.935650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.937209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:52.950247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 379/775] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:52.954951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:52.976680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:52.977748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:52.979632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:52.980056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:52.996848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:52.999986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:53.023821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:53.024925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:53.025997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:53.027692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:53.039386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 397/776] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:53.044984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:53.157592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8770b7b-3551-4c44-9031-04cb3ef31d81 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:53.191011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc046-79ae-46e9-a24f-34cdc116a7a8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:53.228681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:53.229352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.229634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.229910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.230696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:53.231005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:53.232790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:53.245950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 398/777] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:53.250336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:53.251745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:53.254696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.254982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.255254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.256102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] RBAC: Adding query filter params (interface=public, service_id=dc2f16e8306f4184bd43067a161536a8, region_id=RegionOne) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:53.256416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:53.258667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:53.267883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 380/778] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:34:52 2022] GET /identity/v3/endpoints?service_id=dc2f16e8306f4184bd43067a161536a8&interface=public®ion_id=RegionOne => generated 194 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:53.273042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:53.285613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:53.409904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e3178c-b241-4b83-9fac-6f494cec1925 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:53.447827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:53.448406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.448692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.448967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.449797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=a2fb070e53534372a7aa767e458aebfe) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:53.450105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:53.451591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566d334-5d63-4242-bb76-6feffd74239a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:53.459405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 399/779] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:53 2022] GET /identity/v3/role_assignments?user.id=a2fb070e53534372a7aa767e458aebfe&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:53.513972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:53.521496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc400b-6409-4032-a34a-c0779dab62e2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:53.540336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553313-e915-4bda-ae07-b455edce1658 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.540928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553313-e915-4bda-ae07-b455edce1658 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.541212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79553313-e915-4bda-ae07-b455edce1658 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.543609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 400/780] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:53.549751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.550046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.550781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.582750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:53.583997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:53.588935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:53.589671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.589960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.590233 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.590928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:53.592414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:53.605784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 381/781] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:34:53 2022] GET /identity/v3/services => generated 772 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:53.691424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 401/782] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:34:53.719410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:53.844250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f7b1b-349b-4118-a688-5243c090ce2e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:53.883443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ea322-dd36-4616-bbb6-ead1d219b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:53.884270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea322-dd36-4616-bbb6-ead1d219b908 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:53.884553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea322-dd36-4616-bbb6-ead1d219b908 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:53.884830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ea322-dd36-4616-bbb6-ead1d219b908 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:53.900577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ea322-dd36-4616-bbb6-ead1d219b908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-1c1ea322-dd36-4616-bbb6-ead1d219b908 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:53.908480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:53.909402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:53.910220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:53.917028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 382/783] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:53.923588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:53.945983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:54.097815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e9aef-aacf-4522-a5bc-f3e44b6b08a5 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:54.100851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914b4e3-a448-4ef6-b984-816d913c723d None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.101145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914b4e3-a448-4ef6-b984-816d913c723d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.101426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914b4e3-a448-4ef6-b984-816d913c723d None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.103030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 383/784] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:54.108576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.108865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.109139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.137191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:54.138390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:54.152021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:54.152927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.153662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:54.153794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.153794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.154425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:54.155248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:54.156835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:54.166844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 402/785] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:54.173484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:54.267777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:54.279564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58703c88-76f2-4272-8f11-6578b5b22aa8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:54.315600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:54.316403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.317012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.317297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.331641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:54.333102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:54.335094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 384/786] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:54.359369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:54.361419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:54.363421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:54.363421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:54.363421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:54.363421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:54.363421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 403/787] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:54.366265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:54.393449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:54.531551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a1d39-b306-403c-88e3-cc23c5afce07 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:54.559718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:54.574224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:54.575030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.575336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.575615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.596161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fee827-d6ea-4fc2-8088-211c2bfd4d5d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:54.598506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:54.614666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:54.615677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:54.616926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 404/788] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:54.624426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:54.678838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:54.679546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.679836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.680112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.680958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:54.681315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:54.682697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:54.713861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 385/789] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:54.720305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:54.745402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:54.747418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1901e-b5d7-447a-a8cb-68f1cde6eaa1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:54.792654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:54.793338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.793623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.793960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.794712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:54.795069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:54.796778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:54.807338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 405/790] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:54.812853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:54.867802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:54.922414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995eee7-23e2-41ed-8486-b7d25bda1362 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:54.959465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:54.960256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:54.960538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:54.960813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:54.972159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:54.974211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-b993d2a6-68f4-4254-9c30-b4e234348546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:54.993063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:54.995004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:54.996176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:54.996176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:54.996176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:54.996176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:54.996176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 406/791] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:55.001363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6d13b-49e6-4b41-886e-0e47f59f8001 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.002898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6d13b-49e6-4b41-886e-0e47f59f8001 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.003181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6d13b-49e6-4b41-886e-0e47f59f8001 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.004769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 407/792] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:55.005491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6d13b-49e6-4b41-886e-0e47f59f8001 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.031818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307d712-58d0-4487-8566-3ceca0df59c6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.079010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.081067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.081459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.081838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] PATH_INFO: `/v3/users/swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.091623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.094124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.108608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.113786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6d13b-49e6-4b41-886e-0e47f59f8001 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2a77e72f-6598-44e0-9e6f-4d011fc410ba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:55.116557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:55.117478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:34:55.118488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:55.120834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 386/793] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:55.125762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.125762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.125762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.147830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:55.149034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:55.176207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.177128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.177513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.178163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.179209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:55.179549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.181952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.196680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 408/794] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:55.197645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.222225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.239390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 387/795] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:34:55.240583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.309996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c2f42-b73b-4c6b-b1a0-10e4759d22fe None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.347178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.347946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.348235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.348515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.349365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:55.349663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.351212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.361515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de757eb8-9a85-4027-87c2-8de9d21caa78 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.370920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 409/796] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:55.371973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.391965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.399960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.400974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.401478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.401933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.410490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.412225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:55.428178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:55.429120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:34:55.430062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:55.432793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 388/797] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:55.433943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.482517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4bdfb-ea0e-46fb-b7e9-55d5226a7ef3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.495918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.522209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.523007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.523303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.523650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.524305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.525930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:55.540384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:55.541369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 13:34:55.542180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:55.546138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492245c-b207-452e-9eca-aa830af6c817 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.547145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 410/798] 10.222.0.25 () {56 vars in 1129 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:55.548024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.586498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.587695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.588456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.588934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.602421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.604317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:55.626576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:55.627583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:55.629064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:55.629064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:55.629064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:55.629064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:55.629064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 389/799] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:55.629064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.640884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.667687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd2b1b-8246-4bb4-b1d1-0eb580f5d796 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.708497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.709485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.709915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.710337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.711696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:55.712179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.714703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.746687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 411/800] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:55.746687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.753015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6daa679-f1fa-44d3-a098-5064c9d7ccc7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.763414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.794198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.794872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.796075 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.796194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.796888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:55.797205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.798578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5a9d5-4b23-4860-abaa-78c8814f74cd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.808409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 390/801] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:55.809682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2ce61-bb97-4901-b716-7d5560bff8d9 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.809979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2ce61-bb97-4901-b716-7d5560bff8d9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.810265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2ce61-bb97-4901-b716-7d5560bff8d9 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.811758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 391/802] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:55.812302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2ce61-bb97-4901-b716-7d5560bff8d9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.867787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d863bdc-70eb-43f2-a0ae-9a2ce39bc7bf None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.911798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.912418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.912705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.912981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:55.913699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:55.914012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:55.914993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2ce61-bb97-4901-b716-7d5560bff8d9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:55.915424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:55.922554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:55.932534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 412/803] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:55.932534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:55.957031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:55.957678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:55.957959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:55.958231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.001417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.033980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.036132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.036279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecd1e2-5fbf-4604-b760-b42eca68edc9 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.074988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.075897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.076217 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.076458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.077695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:56.078007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.079490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6003bd4-4e40-424f-b3e5-5016f754c99a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.089627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 413/804] 10.222.0.25 () {56 vars in 1124 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:56.089627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.089627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.089627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.103463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:56.104656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:56.152155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 392/805] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:34:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:34:56.153041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.167292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.178183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 414/806] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:34:56.178967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.232871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.257517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ad28e-a408-4218-bb33-45d0e3b1013c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.275567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6557c4-8ce4-49b2-9ac2-0370d735496e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.290144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.290928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.291213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.291525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.298000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.299458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.308279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b1e55e-14b9-4e12-936b-7f38d520cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.308931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1e55e-14b9-4e12-936b-7f38d520cb18 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.309215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1e55e-14b9-4e12-936b-7f38d520cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.309491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b1e55e-14b9-4e12-936b-7f38d520cb18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.310213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1e55e-14b9-4e12-936b-7f38d520cb18 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.312169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b1e55e-14b9-4e12-936b-7f38d520cb18 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:56.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:56.314554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:56.315458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 393/807] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:56.315951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.334577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 415/808] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:34:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:56.335980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d3fd4-60f4-4de4-99ba-f5d821b7df64 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.336268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d3fd4-60f4-4de4-99ba-f5d821b7df64 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.336551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d3fd4-60f4-4de4-99ba-f5d821b7df64 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.342082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 416/809] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:56.342082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d3fd4-60f4-4de4-99ba-f5d821b7df64 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.411878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.435536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e44687-34a9-49a0-8fb1-91ef37582bf0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.479655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.482846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d3fd4-60f4-4de4-99ba-f5d821b7df64 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.485755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.486554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.486837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.487100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.498033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.500262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:56.519663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:56.520573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:56.521462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:56.521462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:56.521462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:56.521462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:56.521462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 394/810] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:56.521742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.528059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c6fa6-5be3-4010-a4a0-01af4a729c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.528878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c6fa6-5be3-4010-a4a0-01af4a729c8f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.529162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c6fa6-5be3-4010-a4a0-01af4a729c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.529436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c6fa6-5be3-4010-a4a0-01af4a729c8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.541426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0c6fa6-5be3-4010-a4a0-01af4a729c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-3e0c6fa6-5be3-4010-a4a0-01af4a729c8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:56.549213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:56.550218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:56.551067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 417/811] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:56.551806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.552365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.552365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.569482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:56.570651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:56.635187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1756db-aa2b-4b7d-be69-776e6951a007 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.647761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 418/812] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:34:56.647761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.680897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.681557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.681851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.682107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.682890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:56.683198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.684665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.686023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.703041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 395/813] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:56.703041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.750378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.762001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2a37f-0a2f-4d3b-93fc-355ea49920c1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.801922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.802595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.802881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.803156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.804079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:56.804396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.805821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.816727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c35a4b-5ad3-4fda-8484-4695237ea0ae None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.818315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 419/814] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:56.819139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.860534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.861206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.861490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.861764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.862627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:56.862920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.864433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.873034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 396/815] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:56.874342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.917280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:56.925740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff59e20-b8d6-42f5-afce-85a5a61b8082 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.960034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:56.960757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:56.961043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:56.961327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] PATH_INFO: `/v3/services/network` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:56.961977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:56.963749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:56.975383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:56.976371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:56.977225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 420/816] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:56.978056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:56.985500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae91b97-f406-4be9-800a-9d88229f2f12 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:56.988198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.024494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.025374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.025661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.025940 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/497f17edb85d4ed999f24690f5bc0ff1/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.027977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=497f17edb85d4ed999f24690f5bc0ff1, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.029417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.051357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 397/817] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:56 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/497f17edb85d4ed999f24690f5bc0ff1/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:57.051357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.105330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd1a38-0ae1-4784-91e8-4246e10ee131 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.145300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.146255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.146613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.146965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.154896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.156576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:57.172423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:57.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:57.174265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:57.178615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 421/818] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:57.179610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.193722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51424-0609-45f9-9c40-d36d85740f42 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.200813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.249648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.250361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.250642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.250914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.262364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.264657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:57.286290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:57.287228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:57.288145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:57.288145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:57.288145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:57.288145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:57.288377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 398/819] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:57.289560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.298561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c5cce-9867-41db-b0ce-f44fbe740a99 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.313743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.349453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.350401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.350683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.350962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.351948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:57.352257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.354380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.363410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 422/820] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:57.364326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.419749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c6c70c-77bb-4c92-965b-518ed44e1b6e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.456584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.463586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.464286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.464572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.464848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.465650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:57.465964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.467473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.481246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 399/821] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:57.482215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.493577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0377c2-1f57-4777-8012-d4df386045f1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.542428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.543596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.544045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.544665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.546448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:57.547159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.549458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.565168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.567129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 423/822] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:57.568587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.590403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fdbc06-77fa-4219-9bfa-3ab2330235c4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.629464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.630617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.631083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.631893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.632772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] RBAC: Adding query filter params (type=network) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:57.633238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.635281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.646967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 400/823] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:57.646967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.693030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af9dda-7c44-4f20-a6b4-ccc9c06f5365 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.727503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.728281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.728707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.729108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.730104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=943294440c3a4d309ff6e6165dcb9d32) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:57.730663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.732353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.739616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 424/824] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/role_assignments?user.id=943294440c3a4d309ff6e6165dcb9d32&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:57.740549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.750804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.771521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05005dc9-131c-49aa-b07a-32a88716735b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.821800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.823284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.823741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.824184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.832426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.834154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.837429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:34:57.852447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:57.853444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:34:57.854388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:57.857132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 401/825] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:57.857269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c237c6-84bf-483e-b93c-00c7280ce1ca None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:57.868410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:57.916679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:57.917393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:57.917924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:57.917998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:57.918757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:57.920206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:57.959993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 425/826] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:34:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:34:57.998570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d983-efd9-4bf8-985f-74d35bbf148d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.063030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.063722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.064010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.064296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.065162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:58.065477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.066960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.087695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 402/827] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 13:34:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:58.094072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.178281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:58.228218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8d6f3-55df-4cff-8a7a-c2511ea8c026 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.262363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.263157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.263467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.263739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.275351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.276818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:34:58.294834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:58.295811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:58.296824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:34:58.296824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:34:58.296824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:34:58.296824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:58.296824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 426/828] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:58.301660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.382915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:58.436161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacf841-e3ec-4cd2-b9c4-97ad0bb34725 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.478920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.479615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.479900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.480173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.480901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:58.481205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.482573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d81bd5-351c-4f6d-b81b-52f480f80037 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.494664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 403/829] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:58.500499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.501655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc943953-a020-4b9c-bc43-352140c5fb41 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.501948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc943953-a020-4b9c-bc43-352140c5fb41 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.502232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc943953-a020-4b9c-bc43-352140c5fb41 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.503825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 404/830] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:34:58.508737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.509026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.509307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.526284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:58.527511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:58.603719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 405/831] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:34:58.619620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc16b-7cbe-426e-aa62-2d29987d05fc None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.621478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.637117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:58.667196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.668134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.668928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.669285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.673167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:58.679641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.682103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:34:58.704205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:58.705251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:34:58.706104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:58.711338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 427/832] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:58.711338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.743284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1158f19-5e3d-4e21-a446-576d5e95a268 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.781019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.782088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.782474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.782936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.783740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.785387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:58.799206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:58.801340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:34:58.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 406/833] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:34:58.808044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.843440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baefe6f-f936-43af-a209-29094dc68c73 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.880340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.881244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.881685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.882124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.883292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:58.883776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.885473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.899114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 428/834] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:34:58.905377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:58.930611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd495275-52de-4087-9dcc-32dd17b2d036 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:58.941357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:58.951699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:58.977669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:58.978374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:58.978663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:58.978941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:58.979699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:58.979990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:58.981360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:58.991075 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 407/835] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:58.996806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:59.022951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0580df9-7bac-456d-9672-1080a5a917c4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:59.063414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5abe76b-ea94-468a-bf2b-be4dcdc66c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:59.065064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abe76b-ea94-468a-bf2b-be4dcdc66c8d None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:59.065559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abe76b-ea94-468a-bf2b-be4dcdc66c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:59.066040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5abe76b-ea94-468a-bf2b-be4dcdc66c8d None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/a2fb070e53534372a7aa767e458aebfe/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:59.088062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abe76b-ea94-468a-bf2b-be4dcdc66c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=a2fb070e53534372a7aa767e458aebfe, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:59.090086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5abe76b-ea94-468a-bf2b-be4dcdc66c8d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:59.109299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 429/836] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:34:58 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/a2fb070e53534372a7aa767e458aebfe/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:34:59.140386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c493dc-6472-4e1e-99b9-1cb0d87dbd61 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:59.181476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:59.182078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:59.182363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:59.182643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:59.183403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:59.183717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:59.185163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c41bb4-e454-4643-b68f-cde97d6d24fa None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:59.190969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 408/837] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:34:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:59.401975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea2f73-0b89-4526-91e5-567c1720b18c None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:59.402372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea2f73-0b89-4526-91e5-567c1720b18c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:59.402555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea2f73-0b89-4526-91e5-567c1720b18c None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:59.404246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 430/838] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:34:59.409571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:59.409861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:59.410138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:59.427040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:34:59.428246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:34:59.462183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:59.504612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 409/839] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:34:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:34:59.527769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea2f73-0b89-4526-91e5-567c1720b18c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:59.617507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:34:59.641462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea2f73-0b89-4526-91e5-567c1720b18c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:59.677378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:59.678176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:59.678465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:59.678746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:59.690106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:34:59.697842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:34:59.698755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:34:59.699652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 431/840] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:34:59.707098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:59.816467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a28e0-6aa6-46bb-b8ee-2d91592169f5 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:34:59.852488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:34:59.853168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:34:59.853456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:34:59.853736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:34:59.854493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:34:59.854804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:34:59.856206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b2459b-17a1-446d-acc6-c172936ad939 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:34:59.865679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 410/841] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:34:59.872638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:34:59.983511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b72c3c-8069-4e9d-a517-530efc7f8745 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.018452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.019254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.019571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.019891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.032080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.033550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.049071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e647b4-aa7c-4522-8ff4-3e539ccf60b0 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.050112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e647b4-aa7c-4522-8ff4-3e539ccf60b0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.050602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e647b4-aa7c-4522-8ff4-3e539ccf60b0 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:00.051590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:00.052519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:00.053398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:00.053398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:00.053398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:00.053398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:00.053398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.053398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 432/842] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:34:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:00.058816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 411/843] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:00.060345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.061190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.061482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.061767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.082139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:00.083857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:00.115415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.166060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343ad3a4-50c7-4b4a-9ae7-e5cb76898df2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.174658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 412/844] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:00.195389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.208392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.209372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.209855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.210328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.211427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:00.211997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.213929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.228023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 433/845] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:00.233599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.308758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.321882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8436f5-a779-46a2-9f52-44d727e4e121 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.362722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c050d47-12da-4210-a5b1-7c3230fe38a8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.373620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.374989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.375479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.375908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.376575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.377993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:00.391064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:00.392052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:00.392876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:00.397154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 413/846] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:00.398405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.406032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.407142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.407694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.408169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.417249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.419078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.426152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:00.437645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:00.438587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 13:35:00.439541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:00.446435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 434/847] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:00.447524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.507523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566de7bf-e736-49d3-ba1a-569dcfb699b8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.542691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.543066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.543369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.543704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.544497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:00.544760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.546146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.555367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 414/848] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:00.556626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.562994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc5182-29f0-403b-92c3-9d8e5635fa46 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.580579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.600027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.601011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.601498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.601974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.603029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:00.603576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.605296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.627439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 435/849] 10.222.0.25 () {56 vars in 1135 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:00.629082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:00.647717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.665686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8a0c3-8cd7-4768-ade4-ad03ffd9d6d8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.702902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.703608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.703899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.704159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.704897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:00.705159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.706526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.719601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 415/850] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:00.737533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9aee4-a016-4c3c-9c68-7aa94e7376f8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:00.777228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:00.778281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:00.778778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:00.779257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:00.828449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:00.856232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:00.857611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:00.970429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 436/851] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 13:35:00.976314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.086265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc372a-e5e1-4469-af75-51549ba56895 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.121038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.121754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.122035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.122307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.133981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.135467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-b44e9de0-46ba-4e94-b21c-5c1d71246a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:01.153502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:01.154415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:01.155441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:01.155441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:01.155441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:01.155441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:01.155441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 416/852] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:01.161812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.195577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0651-8225-4b02-ba97-6c4a097249d3 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.195893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0651-8225-4b02-ba97-6c4a097249d3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.196136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef0651-8225-4b02-ba97-6c4a097249d3 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.197751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 417/853] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:01.202496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.202788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.203068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.208369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:01.222037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:01.223361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:01.256062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:01.289494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfe23-14e7-4d0b-bd69-37e756ff4fc3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.303652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 418/854] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:01.318926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.333178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.333844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.334127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.334399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.335110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:01.335439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.336798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:01.349960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 437/855] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:01.355042 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.434254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ab7e5-3bc0-4ce7-adb9-c8b584f0ae28 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.456655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476093b-7b7a-4ce8-89ff-d212b204c6d3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.466752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:01.473316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d05a92-6d6f-485c-9e1c-8bf5958428b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.474269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d05a92-6d6f-485c-9e1c-8bf5958428b6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.474555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d05a92-6d6f-485c-9e1c-8bf5958428b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.474828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d05a92-6d6f-485c-9e1c-8bf5958428b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.486791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d05a92-6d6f-485c-9e1c-8bf5958428b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:01.494065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-19d05a92-6d6f-485c-9e1c-8bf5958428b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:01.494534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:01.495719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:35:01.502073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:01.502706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.502706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.502706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.502892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 419/856] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:01.502892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7812734-e2d1-45d2-9b7b-6e5517038153 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.502892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7812734-e2d1-45d2-9b7b-6e5517038153 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.502892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7812734-e2d1-45d2-9b7b-6e5517038153 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.502892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 420/857] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:01.502892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7812734-e2d1-45d2-9b7b-6e5517038153 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.504778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:01.513416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.515050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-8b751041-c070-402d-9bc1-b8d6791f413e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:01.530192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:01.531125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:01.532050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:01.536772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 438/858] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:01.537984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.538280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.538558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.555609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:01.556799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:01.614368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7812734-e2d1-45d2-9b7b-6e5517038153 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.625133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 439/859] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:01.625874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.662892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.663591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.663881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.664798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.664908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:01.665206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.666562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:01.675610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 421/860] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:01.680653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.733487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0f1b-0520-4804-8d46-3a0abf498bc9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.739489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:01.757718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:01.769938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.770718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.771107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.771515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.772311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:01.772625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.774067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:01.789799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e590-da44-4c8f-ba5d-3f018b32a7cb None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.793938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 440/861] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:01.794834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.829376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.830048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.830336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.830617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.831364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.832805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:01.848531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 422/862] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:01 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:01.860405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:01.915360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff33e10-d09d-4b4a-a3de-87451c082ce7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:01.971760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:01.973087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:01.974315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:01.974827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:01.992270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:01.994657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:02.001489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a704a8-f4e3-4eae-a869-076829f05bdd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:02.021520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:02.022463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:02.023518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:02.023518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:02.023518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:02.023518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:02.023741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:02.025443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 441/863] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:02.032417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:02.051958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:02.052629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.052919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.053200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.054044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=497f17edb85d4ed999f24690f5bc0ff1) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:02.054363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:02.056136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:02.063257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 423/864] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:01 2022] GET /identity/v3/role_assignments?user.id=497f17edb85d4ed999f24690f5bc0ff1&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:02.074898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:02.157526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b16a86-ce89-48e7-9e89-30469df855a0 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:02.193795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:02.195146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.195621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.196073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.196963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:02.197416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:02.198965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:02.218273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 442/865] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:02.219905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:02.331153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100256f-30be-4b6c-acb7-d68044e2d10c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:02.366051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:02.366861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.367146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.367449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.375898 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:02.377337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:02.393027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:02.393982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:02.394906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:02.398924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 424/866] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:35:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:02.400313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:02.496036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:02.506570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd59a-409a-459f-aa78-e843abfe7e05 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:02.541364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:02.542030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.542312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.542587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.543454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:02.543763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:02.545243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:02.567460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 443/867] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 13:35:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:02.569285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:02.611664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:02.676321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2509790-9cd8-4143-9a3e-91622f121561 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:02.711840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00504-0d07-461f-84f7-852555c47552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:02.712487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00504-0d07-461f-84f7-852555c47552 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.712768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00504-0d07-461f-84f7-852555c47552 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.713040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00504-0d07-461f-84f7-852555c47552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.784853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da00504-0d07-461f-84f7-852555c47552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:02.786514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da00504-0d07-461f-84f7-852555c47552 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:02.826951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:02.895525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 425/868] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:02 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:02.896946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:02.912312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f89bf-3f5e-4a4b-98b5-58cb0cce9521 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.912612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f89bf-3f5e-4a4b-98b5-58cb0cce9521 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.912897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f89bf-3f5e-4a4b-98b5-58cb0cce9521 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.914502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 426/869] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:02.919189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:02.919516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:02.919796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:02.936352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:02.937554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:03.016493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f3d5b-dee1-46aa-abf6-6369eb1c292a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:03.020329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 427/870] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:03.043645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:03.060664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:03.062505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:03.063379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:03.063858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:03.078020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:03.080207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:03.099449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:03.100393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:03.101269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:03.101269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:03.101269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:03.101269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:03.105964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 444/871] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:03.108328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:03.112284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:03.132452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:03.173769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46b370-fdb5-44d3-a78a-b6ea8cb6516d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:03.215484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:03.216801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:03.217325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:03.217775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:03.218672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:03.220984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:03.233225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92340577-e782-44d4-acb3-f20549b1e340 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:03.242983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 428/872] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:03 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:35:03.286984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:03.287826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:03.288186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:03.288542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:03.289352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:03.289732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:03.291275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:03.306191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 445/873] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:03.312079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:03.429138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d07e0-8872-41d8-81aa-0530aea72748 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:03.458812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:03.468355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:03.469155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:03.469471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:03.469734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:03.477401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:03.478847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:03.493984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:03.494878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:03.495809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 429/874] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:03.503206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:03.568086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:03.611670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3d682-3aaf-42b0-a6d5-0d6488a45de6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:03.647248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:03.647943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:03.648231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:03.648512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:03.649309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:03.649620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:03.651062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f887a25-ce64-4465-9949-7a0b7ddd8820 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:03.664818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 446/875] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:03.670757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:03.782511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40260f0c-6a25-4d16-b5f5-4124f730a008 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:03.825266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:03.825914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:03.826204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:03.827033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:03.827904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=a2fb070e53534372a7aa767e458aebfe) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:03.828221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:03.829664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5a6c-3fa2-4791-a17d-445de1fb63c7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:03.836216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 430/876] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:03 2022] GET /identity/v3/role_assignments?user.id=a2fb070e53534372a7aa767e458aebfe&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:04.055192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869c19-7bc6-46c7-ac4a-0a8dc9ea3cf8 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.055901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869c19-7bc6-46c7-ac4a-0a8dc9ea3cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.056418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49869c19-7bc6-46c7-ac4a-0a8dc9ea3cf8 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.058621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 447/877] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:04.064777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41710-8b26-46a4-9156-ffab03f84c0e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.065095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41710-8b26-46a4-9156-ffab03f84c0e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.065364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f41710-8b26-46a4-9156-ffab03f84c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.083955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-10f41710-8b26-46a4-9156-ffab03f84c0e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:04.085151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-10f41710-8b26-46a4-9156-ffab03f84c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:04.135580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:04.158506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 431/878] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:04.181575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869c19-7bc6-46c7-ac4a-0a8dc9ea3cf8 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.274438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd99f-786d-4a56-ab7a-d1ba7f2d336e None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.275430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd99f-786d-4a56-ab7a-d1ba7f2d336e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.275916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbd99f-786d-4a56-ab7a-d1ba7f2d336e None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.277739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 432/879] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:04.282844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.283377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.283860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.291306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49869c19-7bc6-46c7-ac4a-0a8dc9ea3cf8 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.304977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:04.307086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:04.309778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:04.337591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.338641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.339024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.339217 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.339896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.341354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:04.353765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:04.354768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:04.355632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 448/880] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:04.364287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.399342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 433/881] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:04.419358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.507178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91c72c-fae5-4b2c-9ded-390c81ada509 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.530906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bcabc-5f12-411d-b94b-741a71b0aca7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.545760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:04.554507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.555770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.556289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.556990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.558408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:04.558971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.561027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.572096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 449/882] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:04.573283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.573936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.574983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.575501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.576178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.577915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.579534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:04.595560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:04.596564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:04.597383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:04.604997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 434/883] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:04.606278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.631137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:04.696558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861546ca-5e54-4b09-be3b-66b53dcd7da9 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.722844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0a82c-7320-4b7f-9488-077b90e5c9b8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.742036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.743479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.743999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.744758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.745940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:04.746864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.749512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.761185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 450/884] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:04.762392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.764466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.765617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.766138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.767450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.768393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:04.768921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.770488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.781734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 435/885] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:04.783471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:04.839900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:04.905094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e26b-897e-4561-9c20-5b545e958822 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.911509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831baf3e-1ea1-4054-af0d-6c8c8c5ca031 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:04.916252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:04.947885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.949145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.950072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.950782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.952151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] RBAC: Adding query filter params (interface=public, service_id=f9a32917531f485fb3e85223057da6e8, region_id=RegionOne) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:04.952738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.954556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:04.954802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b81464-e4b8-4402-b7cd-2cd3ea60bdb5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.955382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:04.955734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:04.956076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:04.956851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:04.957326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:04.958758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:04.967032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 436/886] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:04.967713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 451/887] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/endpoints?service_id=f9a32917531f485fb3e85223057da6e8&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:04.968590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:05.086819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2b11b-9ee5-483b-ac4a-8d1c602c8624 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:05.090747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:05.126893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7c96f-be26-4e60-8377-7701dd936414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:05.127926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c96f-be26-4e60-8377-7701dd936414 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.128394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c96f-be26-4e60-8377-7701dd936414 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.128955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7c96f-be26-4e60-8377-7701dd936414 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.129815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7c96f-be26-4e60-8377-7701dd936414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:05.131420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7c96f-be26-4e60-8377-7701dd936414 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:05.138297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 437/888] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:35:04 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:35:05.398265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fb99-bf58-417a-a855-b3f85cc67992 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.398771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fb99-bf58-417a-a855-b3f85cc67992 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.398771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874fb99-bf58-417a-a855-b3f85cc67992 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.400521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 452/889] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:05.406234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94351597-698e-4389-9f43-ae757acb8641 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.406662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94351597-698e-4389-9f43-ae757acb8641 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.406860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94351597-698e-4389-9f43-ae757acb8641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.424403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-94351597-698e-4389-9f43-ae757acb8641 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:05.425649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-94351597-698e-4389-9f43-ae757acb8641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:05.496930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 438/890] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:05.519462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fb99-bf58-417a-a855-b3f85cc67992 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:05.631569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874fb99-bf58-417a-a855-b3f85cc67992 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:05.671620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:05.672900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.673488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.673975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.674917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:05.676544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:05.690153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:05.691134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:05.692004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:05.694915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 453/891] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Jul 6 13:35:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:05.701093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94351597-698e-4389-9f43-ae757acb8641 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:05.803843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:05.811772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94351597-698e-4389-9f43-ae757acb8641 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:05.848510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:05.849561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.850065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.850566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.851535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:05.852068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:05.853640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87e512-35b9-4da5-95ca-2d93f0cd06e5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:05.858960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 439/892] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:05.864907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:05.908919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:05.967671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173384-3faf-450f-b6af-28f6e4b71789 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.968298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173384-3faf-450f-b6af-28f6e4b71789 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.968924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7173384-3faf-450f-b6af-28f6e4b71789 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.971384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 440/893] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:05.977076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:05.977369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:05.977666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:05.978821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91661a42-d5cd-49b4-9de4-b7368a92721a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:05.994267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:05.995488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:06.024577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.025532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.025831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.026118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.026845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:06.027134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:06.029067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:06.036163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 454/894] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:06.041952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.091647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 441/895] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:06.117157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.173388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de1610-c8c5-488d-8723-d2c1f381738b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:06.176041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:06.216402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:06.220394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.221727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.222301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.222783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.224227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] RBAC: Adding query filter params (interface=public, service_id=b4c6cbba112145faba39854dfcf80339, region_id=RegionOne) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:06.224877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:06.226523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:06.227001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45ef50-b946-4928-9f74-6da3e5769b79 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:06.233683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 455/896] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/endpoints?service_id=b4c6cbba112145faba39854dfcf80339&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:06.238582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.278939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.279813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.280097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.280370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.294230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:06.306469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:06.307472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:06.308296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:06.311393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 442/897] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:06.314429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.357807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72bd7-61bf-49cc-b864-18c9b2fc54fc None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:06.395066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.395770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.396053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.396328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.396999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:06.398365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:06.411612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 456/898] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:35:06.445802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83419992-d858-4045-94f1-1e6d09f04b5f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:06.486110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.487150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.487687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.488173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.489189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:06.489728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:06.491380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:06.502110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 443/899] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:06.508264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.543373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:06.617870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8cda5-4eb0-4d36-9669-c1e31ce89542 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:06.655552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.656719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.657252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.657732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.668520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:06.670753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:06.691465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:06.692406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:06.693347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:06.693347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:06.693347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:06.693347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:06.699675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 457/900] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:06.701534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.719066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:06.814259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174861bf-3b92-4486-bdb0-08c739f27d84 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:06.852170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:06.852833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:06.853153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:06.853440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:06.854164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:06.854475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:06.855874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d59263-ae5e-41dc-8c53-5e0b5280f51b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:06.869059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 444/901] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:06.874567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:06.963514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:06.986809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b5a36-eb34-4ee7-bb05-d6d38566e653 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.028624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.029956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.030240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.030510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.038147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.039622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:07.055596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:07.056601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:07.057533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 458/902] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:35:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:07.062461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a1d2-22aa-4876-ab58-3560756e15f5 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.062756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a1d2-22aa-4876-ab58-3560756e15f5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.063037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1a1d2-22aa-4876-ab58-3560756e15f5 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.064911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 445/903] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:07.065290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.069799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.070090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.070371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.086804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:07.088022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:07.166626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 446/904] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:07.186429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6747abaf-92ad-4823-91f0-68ea1b6cf59a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.189114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.193157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:07.238786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.240144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.240693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.241660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.243005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:07.243766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.245884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.267666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:07.273229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 459/905] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:07.278451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.306735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f0bba-590f-45f4-8a76-f94752f67f79 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.343883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69429cc2-c529-4dc7-ae7d-88ab63a6fbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.344531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429cc2-c529-4dc7-ae7d-88ab63a6fbe6 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.344814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429cc2-c529-4dc7-ae7d-88ab63a6fbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.345396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69429cc2-c529-4dc7-ae7d-88ab63a6fbe6 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.346129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69429cc2-c529-4dc7-ae7d-88ab63a6fbe6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.347509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69429cc2-c529-4dc7-ae7d-88ab63a6fbe6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.370575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 447/906] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:07 2022] POST /identity/v3/services => generated 241 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:07.370575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc1e89-897f-4683-9999-3abdb2abbb3f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.370575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc1e89-897f-4683-9999-3abdb2abbb3f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.370575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc1e89-897f-4683-9999-3abdb2abbb3f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.370575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 448/907] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:07.373061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.373356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.373931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.398125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44db3ae-242e-426f-b240-002070c37b0f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.399303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:07.402332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:07.455593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.456301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.456530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.457694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.479228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:07.495802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 449/908] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:07.515197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.544614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:07.551894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.553364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.637687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e48fb9-53c6-4ab2-b031-35c77b5d098e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.673218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.674017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.674301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.674575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.675232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.676613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.679378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 460/909] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 13:35:07.684396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:07.689279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:07.690465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:07.691513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 450/910] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:07.698511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.764450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:07.809741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:07.816641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ae80-85cc-4cfd-a5ea-0d4cd975790a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.827580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3742dc3-1262-4b75-b0ab-42bef85352de None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:07.863240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.864137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.864424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.864702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.866352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:07.867500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:07.867981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:07.868452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:07.869370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:07.869872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.871555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.876098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:07.877537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:07.884422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 451/911] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:07.885309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:07.900220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:07.901174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:07.902213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:07.902213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:07.902213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:07.902213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:07.902213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 461/912] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:07.908387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:07.993273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29666f9-76ea-49b9-87b1-2657cc988297 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.022318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:08.037027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b69de6-41eb-4ebc-858a-c0227f551df6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.039142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.040879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.041315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.041732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.042585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:08.043055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.044595 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.057835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 452/913] 10.222.0.25 () {56 vars in 1114 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:08.059095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:08.079018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.079789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.080433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.080551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.081209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:08.081604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.083039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.101141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 462/914] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:08.102788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:08.116756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:08.182641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707a169-787e-49ec-af87-a13c1ed12954 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.224535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.225775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.226269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.226931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.228523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.230065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.230207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3d3dd9-83b8-4114-903a-bad3a2207627 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.258850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 453/915] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:35:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:08.282462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.283582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.284036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.284476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.292919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.294707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:08.312344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:08.313539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:08.314576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:08.316972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 463/916] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:08.323058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:08.382023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:08.450225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a942b13-c17a-4808-b835-c9a720b9e3f2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.487255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.488036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.488229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.488505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.489307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:08.489617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.491065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3d024-b6a7-4682-982b-95f42a3c1e19 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.505249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 454/917] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:08.510901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:08.579200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:08.588865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c8da8-63ab-4040-965d-9ce6f0c2d862 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.589151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c8da8-63ab-4040-965d-9ce6f0c2d862 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.589422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c8da8-63ab-4040-965d-9ce6f0c2d862 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.592531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 455/918] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:08.596570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.596854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.597129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.615391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:08.616578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:08.620943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f285f-6efc-4a4a-b5bf-24f58033ce83 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.656785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.657452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.657733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.658008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.658834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] RBAC: Adding query filter params (role.id=2e615436f119421aab3bd3328b026a6b, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=a2fb070e53534372a7aa767e458aebfe) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:08.659149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.660613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.666534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 464/919] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:08 2022] GET /identity/v3/role_assignments?user.id=a2fb070e53534372a7aa767e458aebfe&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=2e615436f119421aab3bd3328b026a6b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:08.695507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 456/920] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:08.712695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:08.827799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078f05b-5f3e-4835-a446-4f658b4515a5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:08.859780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:08.863606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:08.864451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:08.864807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:08.865187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:08.865918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:08.867669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:08.880618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:08.881531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:08.882652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 465/921] 10.222.0.25 () {56 vars in 1132 bytes} [Wed Jul 6 13:35:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:08.890279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:08.921320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:08.995649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f0d33-a6e4-42f2-a543-708ab037ee10 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:09.031307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:09.032003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.032289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.032569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.033341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:09.033654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:09.035026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:09.040530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 457/922] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:09.046204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:09.152246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c89ca9-7e93-42e3-890e-04efb2faea64 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:09.191620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:09.192294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.192580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.192860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.193565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:09.193873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:09.195247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdebcea-c6a0-4cb4-a103-0c0008fe7a43 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:09.200646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 466/923] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:09.206773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:09.303848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:09.313542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80ee68-c9e5-41a1-a92b-442e7bc406fa None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:09.348936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f63707-168d-4a8e-90c1-25e2c28f8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:09.349931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f63707-168d-4a8e-90c1-25e2c28f8ac0 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.350533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f63707-168d-4a8e-90c1-25e2c28f8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.351009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f63707-168d-4a8e-90c1-25e2c28f8ac0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.351976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f63707-168d-4a8e-90c1-25e2c28f8ac0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:09.353536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f63707-168d-4a8e-90c1-25e2c28f8ac0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:09.379474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 458/924] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:35:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:09.557969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7070ce-db88-4d3c-b284-575a62fdb38a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.558449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7070ce-db88-4d3c-b284-575a62fdb38a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.558449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7070ce-db88-4d3c-b284-575a62fdb38a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.560082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 467/925] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:09.565995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.566387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.566583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.583759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:09.585216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:09.658733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 459/926] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:09.681278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7070ce-db88-4d3c-b284-575a62fdb38a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:09.739141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:09.786594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7070ce-db88-4d3c-b284-575a62fdb38a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:09.825669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:09.826443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.826730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.827010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.827752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:09.829137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:09.843046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:09.844281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:09.845280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 468/927] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:09.852464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:09.933496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:09.956091 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaed3e-29fa-4c27-852c-f1f49a5b9ded None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:09.991363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:09.992037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:09.992323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:09.992601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:09.993321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:09.993626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:09.995133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:10.000431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 460/928] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:10.005676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:10.115708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07193bb6-4751-4a2b-96eb-0c46c3da26cc None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:10.136800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:10.152497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:10.153166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.153454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.153733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.154476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:10.154786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:10.156194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:10.161719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 469/929] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:10.168439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:10.272180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebd135-0232-415f-889f-a2921d4ee82c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:10.305993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:10.306652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.306932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.307203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.308017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] RBAC: Adding query filter params (interface=public, service_id=9b83b345ece54f1f93d771550ca6979a, region_id=RegionOne) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:10.308327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:10.309687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26df6092-f3a4-423f-9a7f-3ca9f46cce72 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:10.315912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 461/930] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:35:10 2022] GET /identity/v3/endpoints?service_id=9b83b345ece54f1f93d771550ca6979a&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:10.321544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:10.420857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63910-5514-42bc-8d48-a0d05273f9c9 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.421476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63910-5514-42bc-8d48-a0d05273f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.421985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db63910-5514-42bc-8d48-a0d05273f9c9 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.423825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 462/931] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:10.428415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4843a-3f73-49d2-a63d-c4785f2b89f1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:10.428909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.429401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.429900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.444576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:10.450815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:10.452753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:10.477641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:10.478618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.479093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.479644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.480511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:10.482064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:10.490050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 470/932] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:35:10 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:35:10.538179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 463/933] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:10.562048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:10.617717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:10.677626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76600a47-2b2d-4cf7-8fc1-6b78b0e0457a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:10.712288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:10.712947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.713487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.713768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.714476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:10.715977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:10.717884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING keystone.server.flask.common [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 06 13:35:10.740800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.sql.core [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 13:35:10.740800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 13:35:10.740800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [parameters: {'id': '75ca6cdc7a174346a32557410d1a1df5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 13:35:10.740800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86852) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-e8ea1845-c611-4204-9c76-a7a9722d1e64 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75ca6cdc7a174346a32557410d1a1df5.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75ca6cdc7a174346a32557410d1a1df5. Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application conn.query(q) Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 13:35:10.748774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result.read() Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 06 13:35:10.749567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application next(self.gen) Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application yield resource Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application next(self.gen) Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise self.value Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application session.commit() Jul 06 13:35:10.750501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.session.flush() Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application compat.raise_( Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 13:35:10.751417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 13:35:10.752304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application conn.query(q) Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result.read() Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 13:35:10.753086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [parameters: {'id': '75ca6cdc7a174346a32557410d1a1df5', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:10.754016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:10.754778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 75ca6cdc7a174346a32557410d1a1df5. Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:10.755685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 471/934] 10.222.0.25 () {60 vars in 1140 bytes} [Wed Jul 6 13:35:10 2022] POST /identity/v3/projects => generated 262 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:10.762378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:10.866258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f616c-1eca-44d2-a3c5-60d30565f530 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:10.874077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c56be-07d0-4461-ad9f-c5e99e4689c7 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.874449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c56be-07d0-4461-ad9f-c5e99e4689c7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.874807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c56be-07d0-4461-ad9f-c5e99e4689c7 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.879285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 472/935] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:10.884419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.884787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.885145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.903586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:10.905767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:10.909701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:10.910708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:10.911187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:10.911658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:10.914853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:10.920636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:10.922401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:10.938334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:10.939231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:10.940156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:10.942662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 464/936] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:10.948854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:10.991556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 473/937] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:11.007367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.046048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:11.070247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb6032-4947-438d-8d46-db343c8c6c92 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.107693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.108645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.109149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.109672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.110570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:11.111031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:11.112840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:11.118618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26b22-4ad2-4067-85ec-25f552e7ed86 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.132013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 465/938] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:11.160568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.161434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.161720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.162000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.175083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:11.183693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:11.184710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:11.185599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 474/939] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:11.191136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.258406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:11.310190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07110919-f677-4ac9-bef0-582afb361ad7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.348748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.349432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.349720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.349999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.350763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:11.351073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:11.352546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:11.361815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 466/940] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:11.367609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.480653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:11.488287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d476a-3d44-4b85-9cdc-6cc2df608331 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.527823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.528621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.528906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.529213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.539936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:11.541547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-1ef5214d-84eb-44dd-8e06-484f1b3450b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:11.559609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:11.561101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:11.562092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:11.562092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:11.562092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:11.562092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:11.562092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 475/941] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:11.568960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.615652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06318a-8325-455d-ad80-3ecc57d78ec2 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.615983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06318a-8325-455d-ad80-3ecc57d78ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.616230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06318a-8325-455d-ad80-3ecc57d78ec2 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.617886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 476/942] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:11.622726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.623680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.623859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.641262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:11.642593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:11.683070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab5ec-f80f-49de-96f3-c29dc1f7d42b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.705265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:11.725288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.726345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.726789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.727224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.728150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:11.728624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:11.730252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:11.731554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 477/943] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:11.749747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 467/944] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:11.753469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.757450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.852604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:11.875685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaa097-d395-433a-8c27-f62d81dd389b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.885213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e95bf9f-f2c0-461b-b23e-a1ed5b1a0e37 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:11.913077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.914442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.915053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.915582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.924778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:11.926789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:11.928190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:11.929238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:11.929527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:11.929801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] PATH_INFO: `/v3/services/compute` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:11.931143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:11.932543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:11.944590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:11.945529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:11.946471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:11.947030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:11.947984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:11.948826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:11.951221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 478/945] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:11.952001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 468/946] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:11.952598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:11.958163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.002522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:12.070148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdcc11-30f7-4bde-909e-87312e12a419 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.087246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ce65-92cc-4e67-a26b-5d1b8ba9605b None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.109114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.109832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.110080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.110356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.111270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:12.111933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.113066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.138985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 469/947] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:12.139186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.139186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.139186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.139186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.139516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:12.139856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.141367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.142749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.151358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 479/948] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:12.155929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.162068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:12.249208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:12.256247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4d78a-1371-4ca3-b983-7edcac3d240c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.293510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.294492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.295468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.295850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.300056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8be7d-844c-4dda-96b8-479e0e94ca59 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.307343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.309521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:12.334849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:12.335997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:12.337088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:12.337088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:12.337088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:12.337088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:12.337649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.338667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.339047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.339532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.340682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] RBAC: Adding query filter params (type=compute) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:12.340682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.345351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.345563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 470/949] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:12.347759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.350439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 480/950] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:12.469685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5fa1b0-e8b6-43fb-a2f6-83f6d5d29382 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.507194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.508142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.508570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.509012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.509897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:12.510204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.511592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d1147-a327-46cc-b57b-cb8f98297d43 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.524574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 471/951] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:12.530960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.609844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:12.645240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce437fc2-9cc0-45d7-95f8-cee00110ea3e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.679923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.681023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.681496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.681943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.688955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.690592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:12.705680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:12.706777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:12.707768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:12.708214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b0f02-ba53-486f-8f22-01a0e01fadf4 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.708214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b0f02-ba53-486f-8f22-01a0e01fadf4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.708654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b0f02-ba53-486f-8f22-01a0e01fadf4 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.709953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 472/952] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:12.710742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 481/953] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:12.715576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.715720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.716003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.717448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.733069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:12.734260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:12.747930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:12.823649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 473/954] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:12.839358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1bc07e-c7c8-40ce-9337-af2810b1245a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.842004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.879710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:12.891912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.893360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.893847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.894683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.895983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:12.896501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.899060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:12.916349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 482/955] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:12.922845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:12.957001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f954d-63b6-44d2-a8ae-531a0464253f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:12.993048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:12.993967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:12.994345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:12.994867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:12.995423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:12.996868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:13.010094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:13.011168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:13.012124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:13.015846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 474/956] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:13.018789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:13.021426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:13.053027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cc65f-e878-427b-8f15-c40a4a182192 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:13.090986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:13.092265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.092792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.093291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/a2fb070e53534372a7aa767e458aebfe/roles/2e615436f119421aab3bd3328b026a6b` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.095783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=a2fb070e53534372a7aa767e458aebfe, role_id=2e615436f119421aab3bd3328b026a6b)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:13.097465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.115427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 483/957] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:35:12 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/a2fb070e53534372a7aa767e458aebfe/roles/2e615436f119421aab3bd3328b026a6b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:35:13.126087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab4a18-8033-409d-8bdf-30097ec03a1a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:13.179461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:13.180143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.180431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.180711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.181446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:13.181757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:13.183356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.190146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 475/958] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:13.195929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:13.253124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:13.308247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75be78-e1f9-45d9-bb29-637dfc650cab None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:13.343191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:13.343818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.344101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.344376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.345084 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:13.345392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:13.346763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a4dca-0b13-41d2-9281-92719cfe1ae3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.352146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 484/959] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:13.358199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:13.403551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5ac0-3a38-4285-a17b-3cd456715b8d None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.404258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5ac0-3a38-4285-a17b-3cd456715b8d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.404551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5ac0-3a38-4285-a17b-3cd456715b8d None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.406732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 485/960] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:13.411206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652c983-e281-4181-990e-339905f537eb None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.411791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652c983-e281-4181-990e-339905f537eb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.412171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652c983-e281-4181-990e-339905f537eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.433198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5652c983-e281-4181-990e-339905f537eb None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:13.434064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:13.435199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5652c983-e281-4181-990e-339905f537eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:13.474641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579199f-c105-4cad-bd87-98bc2f4f0d6d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:13.511839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:13.512514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.512849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.513131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.513965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:13.515544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.527423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 486/961] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:13.544348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 476/962] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:35:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:13.554563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652c983-e281-4181-990e-339905f537eb None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:13.608886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:13.668686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652c983-e281-4181-990e-339905f537eb None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:13.712637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:13.713582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.713853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.714129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.714841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:13.716302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.730980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.sql.core [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 13:35:13.730980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 13:35:13.730980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [parameters: {'user_id': '637117f6a88b43e09bb662ce77bf3086', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 13:35:13.730980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86852) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application conn.query(q) Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result.read() Jul 06 13:35:13.738864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 13:35:13.739871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application next(self.gen) Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application yield resource Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application next(self.gen) Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise self.value Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application session.commit() Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 13:35:13.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.session.flush() Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application compat.raise_( Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 13:35:13.741773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 13:35:13.742686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application conn.query(q) Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application result.read() Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 13:35:13.745019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [parameters: {'user_id': '637117f6a88b43e09bb662ce77bf3086', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:13.747070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 06 13:35:13.749003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:13.751900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 487/963] 10.222.0.25 () {60 vars in 1131 bytes} [Wed Jul 6 13:35:13 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:13.752856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:13.856717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9b813-3c4c-4d0a-bb84-556a5de038e1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:13.881098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:13.893626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:13.894767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:13.895588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:13.896157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:13.905061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:13.906889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ff55f73d-e6aa-4841-8b68-eda518ca8740 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:13.922032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:13.922984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 13:35:13.923970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:13.927659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 477/964] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:13.929597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:14.036149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:14.039431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6efec-7246-4782-92ae-9d6b123b8c20 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:14.074895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:14.075631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:14.076423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:14.076715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:14.077587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:14.077905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:14.079592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee918a-c61c-44c1-8372-f816f7e53ba1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:14.120066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 488/965] 10.222.0.25 () {56 vars in 1101 bytes} [Wed Jul 6 13:35:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:14.481409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b59423-9307-4625-a8e3-6f0fd4e19571 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:14.481955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b59423-9307-4625-a8e3-6f0fd4e19571 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:14.482224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b59423-9307-4625-a8e3-6f0fd4e19571 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:14.483691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 478/966] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:14.488643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aec39-2094-44ca-9d29-1ca9045b2cc0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:14.488939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aec39-2094-44ca-9d29-1ca9045b2cc0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:14.489221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401aec39-2094-44ca-9d29-1ca9045b2cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:14.506267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-401aec39-2094-44ca-9d29-1ca9045b2cc0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:14.507775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-401aec39-2094-44ca-9d29-1ca9045b2cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:14.575528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 489/967] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:14.597782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b59423-9307-4625-a8e3-6f0fd4e19571 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:14.698860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b59423-9307-4625-a8e3-6f0fd4e19571 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:14.733070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914a61ce-159c-4955-ab8b-865338868084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:14.733649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a61ce-159c-4955-ab8b-865338868084 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:14.733930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a61ce-159c-4955-ab8b-865338868084 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:14.734200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a61ce-159c-4955-ab8b-865338868084 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:14.734921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a61ce-159c-4955-ab8b-865338868084 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:14.736305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914a61ce-159c-4955-ab8b-865338868084 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:14.755362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 479/968] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:14 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:15.200306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdfe23-bb1c-4825-9a21-d9b0c6bfa064 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.200850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdfe23-bb1c-4825-9a21-d9b0c6bfa064 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.200850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdfe23-bb1c-4825-9a21-d9b0c6bfa064 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.202292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 490/969] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:15.207508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.207798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.208079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.225334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:15.226507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:15.261187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:15.300213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 480/970] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:15.322868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdfe23-bb1c-4825-9a21-d9b0c6bfa064 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:15.413508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:15.427710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdfe23-bb1c-4825-9a21-d9b0c6bfa064 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:15.462336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:15.463355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.463644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.463924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.475615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:15.483980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:15.484924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:15.485772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 491/971] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 13:35:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:15.491125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:15.592384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba65c1-4e6a-48a0-888b-e9cdc8f1209d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:15.625527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:15.626199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.626486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.626761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.627532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:15.627841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:15.629212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef353673-ba9b-4adf-907f-07f8fcb55e45 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:15.642087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 481/972] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:35:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:15.643671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:15.700753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba3615-69dc-48ed-aa94-89a7701404bb None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.701619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba3615-69dc-48ed-aa94-89a7701404bb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.701835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba3615-69dc-48ed-aa94-89a7701404bb None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.703239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 482/973] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:15.708013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.708299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.708579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.725671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:15.726785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:15.751403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:15.755059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ffbcb-7b67-44f1-a5b4-045e2d2ff783 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:15.795233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:15.796073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.796359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.796640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.802535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 483/974] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:15.813709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:15.815170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:15.824319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:15.825215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:15.835558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:15.836660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:15.837772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:15.837772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:15.837772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:15.837772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:15.839907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 492/975] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:15.845287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:15.931589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0da2e2-1376-448e-be01-e8b27cea276e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:15.956448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b9fcc-656e-404b-9606-c8a01584466d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:15.968119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:15.968923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.969204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.969477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.970130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:15.971524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:15.983553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:15.984629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:15.986063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 484/976] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:15.990845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:15.995308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:15.995996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:15.996280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:15.996560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:15.997284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:15.997592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:15.999517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.012478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 493/977] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:16.018313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.018464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.083018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.101654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d798655-97e5-4a52-8548-39df258958b2 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.129028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb65e8-9956-44bc-bb7c-1c1d5aaa4dca None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.139429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.140105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.140390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.140669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.141388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:16.141698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.143065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.147922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 485/978] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:16.153493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.168901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.170240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.170530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.170809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.178689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.180688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:16.196031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:16.197013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 13:35:16.197980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:16.201975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 494/979] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:16.202804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.246744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.260192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333d86-b8d6-4e08-874e-aff888eebd75 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.301262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.301933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.302370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.302655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.303866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:16.304297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.306129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.308588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd1f32-08f4-4029-86f8-ff2c79f6d628 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.317448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 486/980] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:16.318846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.329409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.344699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.345382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.345666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.345949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.346790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:16.347104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.348592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.366993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 495/981] 10.222.0.25 () {56 vars in 1149 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:16.372289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.429472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a161f74-f1a0-4f08-9cf0-3c2459f811f1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.468763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.469905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.470532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.471013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.472081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] RBAC: Adding query filter params (interface=admin, service_id=9b83b345ece54f1f93d771550ca6979a, region_id=RegionOne) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:16.472694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.474377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.475765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe0fd5-b142-4ccb-a471-7eff701d5381 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.480428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 487/982] 10.222.0.25 () {56 vars in 1249 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/endpoints?service_id=9b83b345ece54f1f93d771550ca6979a&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:16.486369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.505373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.515631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76aada-4ed0-4042-856e-e9914282aca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.516290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76aada-4ed0-4042-856e-e9914282aca1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.516579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76aada-4ed0-4042-856e-e9914282aca1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.517019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76aada-4ed0-4042-856e-e9914282aca1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.566119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.590053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76aada-4ed0-4042-856e-e9914282aca1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.592145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76aada-4ed0-4042-856e-e9914282aca1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.592943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f19b31-2ba6-45fc-99ea-ceb3c9842dc7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.626864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.627562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.627844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.628116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.628788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.630135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.636552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 488/983] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:35:16.712713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 496/984] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 13:35:16.719244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.812147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:16.819192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20cb46-970f-4ed6-ae21-60821a6534e3 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.819486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20cb46-970f-4ed6-ae21-60821a6534e3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.819764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20cb46-970f-4ed6-ae21-60821a6534e3 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.821708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 497/985] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:16.826915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.827207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.827511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.833770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5320b29-c397-4072-b8a6-8bf5398319c4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:16.845722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:16.847012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:16.870041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:16.870831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:16.871115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:16.871415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:16.883013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:16.884498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:16.902193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:16.903130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:16.904650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:16.904650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:16.904650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:16.904650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:16.906296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 489/986] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:16.909732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.926333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 498/987] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:16.948758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:16.960043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:17.016065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5eb3b5-4e6e-4e54-b201-954cd3ae50b7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.045279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:17.050696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.051394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.051679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.051957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.052678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:17.052979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.054339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.060534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe7f59-4b22-477e-911d-2eaf352c0ea2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.069217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 490/988] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:17.074419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.097022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.097818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.098101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.098375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.099030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.100422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:17.112367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:17.113400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:17.114257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:17.118502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 499/989] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:17.119375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.181693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f65a1-7735-49fb-a700-9093f30f8109 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.194983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:17.219546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.220383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.220673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.221003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.227594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.229043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.231598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7edf5-1b55-44a1-8d15-fcf60a2df6fe None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:17.243185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:17.244249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:17.245164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 491/990] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:17.250120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.270382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.271334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.271824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.272267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.273128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] RBAC: Adding query filter params (name=compute) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:17.273586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.275399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.281287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 500/991] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:17.286779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.302729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:17.353076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ebc4d-b803-4689-8cdc-c87ef5904b9d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.392298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.393068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.393347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.393619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.394401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:17.394707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.395700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f097-355c-4e5f-9fcf-cfc9d5161c6c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.396278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.411175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 492/992] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:17.416775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.430373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.431040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.431352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.431643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.432353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:17.432662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.434091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.436646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:17.444635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 501/993] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:17.446375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.520065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac034d17-4ed4-4770-8dbf-f91281260335 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.533961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:17.548331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b5030-fa7f-4c73-ba21-c76db56ff041 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.555751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.556401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.556688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.556957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.557771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] RBAC: Adding query filter params (role.id=2e615436f119421aab3bd3328b026a6b, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=a2fb070e53534372a7aa767e458aebfe) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:17.558078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.559522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.566024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 493/994] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/role_assignments?user.id=a2fb070e53534372a7aa767e458aebfe&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=2e615436f119421aab3bd3328b026a6b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:17.584012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.584702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.584995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.585272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.586087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] RBAC: Adding query filter params (interface=public, service_id=d501372038564fdf87389662ad31077c, region_id=RegionOne) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:17.586408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.587871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e37ec-bd10-4119-aea6-be96d653c490 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.598811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 502/995] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/endpoints?service_id=d501372038564fdf87389662ad31077c&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:17.599968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:17.706949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a282a4-31d0-4e96-9f4a-568c1f3cc438 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:17.743210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31965b75-7056-4591-b557-b2603a55d365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:17.744017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31965b75-7056-4591-b557-b2603a55d365 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:17.744297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31965b75-7056-4591-b557-b2603a55d365 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:17.744572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31965b75-7056-4591-b557-b2603a55d365 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:17.745257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31965b75-7056-4591-b557-b2603a55d365 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:17.746648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31965b75-7056-4591-b557-b2603a55d365 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:17.754551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 494/996] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:35:17 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:35:18.702014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4bdc9-20f0-4689-acb2-c3d3e2e3ae7e None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:18.702540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4bdc9-20f0-4689-acb2-c3d3e2e3ae7e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:18.702647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4bdc9-20f0-4689-acb2-c3d3e2e3ae7e None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:18.704166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 503/997] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:18.709579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:18.709989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:18.710169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:18.728662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:18.729846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:18.765709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:18.810903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 495/998] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:18.833271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4bdc9-20f0-4689-acb2-c3d3e2e3ae7e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:18.899740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:18.939917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4bdc9-20f0-4689-acb2-c3d3e2e3ae7e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:18.973608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:18.974338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:18.974620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:18.974898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:18.975621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:18.976991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:18.988977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:18.989944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 13:35:18.990887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:18.995070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 504/999] 10.222.0.25 () {56 vars in 1126 bytes} [Wed Jul 6 13:35:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:18.996315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:19.099131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3e198-4fc9-4a74-812f-55c671a10fef None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:19.133971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:19.134684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.134980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.135258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.135988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:19.136301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:19.137712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:19.147346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 496/1000] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:19.148964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:19.254218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ae32c-44c7-4279-a3f9-1068ea8e94cd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:19.280228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:19.289327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:19.289992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.290280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.290558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.291259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:19.291600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:19.292966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977a7b1-cadd-417f-89e7-139d0a7fbaec None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:19.298749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 505/1001] 10.222.0.25 () {56 vars in 1122 bytes} [Wed Jul 6 13:35:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:19.304196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:19.338656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:19.405669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7b03-37fc-46c1-971d-2aa1f36bf818 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:19.439503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99602e2-096a-42fd-940d-c4f94792ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:19.440160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99602e2-096a-42fd-940d-c4f94792ac20 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.440446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99602e2-096a-42fd-940d-c4f94792ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.440720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99602e2-096a-42fd-940d-c4f94792ac20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.441470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99602e2-096a-42fd-940d-c4f94792ac20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:19.442842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99602e2-096a-42fd-940d-c4f94792ac20 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:19.457449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 497/1002] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:35:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:19.615824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969280-d4a6-484f-b172-169a41f07961 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.616152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969280-d4a6-484f-b172-169a41f07961 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.616465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19969280-d4a6-484f-b172-169a41f07961 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.617843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 506/1003] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:19.623558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c577-f2dd-4542-9014-01c37a07219a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.623855 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c577-f2dd-4542-9014-01c37a07219a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.624128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49c577-f2dd-4542-9014-01c37a07219a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.641819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-df49c577-f2dd-4542-9014-01c37a07219a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:19.643019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-df49c577-f2dd-4542-9014-01c37a07219a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:19.722551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 498/1004] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:19.745158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969280-d4a6-484f-b172-169a41f07961 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:19.790522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c73a-4582-42a6-b81a-4a1cf5ef00c3 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.790838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c73a-4582-42a6-b81a-4a1cf5ef00c3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.791090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554c73a-4582-42a6-b81a-4a1cf5ef00c3 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.792617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 499/1005] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:19.797418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.797709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.797992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.817499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:19.818698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:19.834316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:19.863613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19969280-d4a6-484f-b172-169a41f07961 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:19.897165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 500/1006] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:19.904163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:19.905281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:19.905790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:19.906333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] PATH_INFO: `/v3/services/image` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:19.907219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:19.908817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:19.920105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:19.921592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:19.922553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:19.924175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 507/1007] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Jul 6 13:35:19 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:19.928501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:19.989985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:20.032191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb762d-7a6f-4c8c-a006-d790ef9dee1d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:20.035604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7f79c-2f0e-4939-8925-8e5108e6924a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:20.070290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:20.071082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:20.071268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:20.071489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:20.071660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:20.071916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:20.072198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:20.072294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:20.072473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:20.073168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] RBAC: Adding query filter params (name=image) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:20.073475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:20.073666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:20.074814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:20.084635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 508/1008] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:20.085288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:20.085938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:20.086913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 13:35:20.087803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:20.092244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 501/1009] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:20.093322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:20.112012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:20.194765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651dbab-f504-4d74-b519-068b74085e4d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:20.204823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc59cb9-a90e-4497-a767-0f440f22ccc1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:20.215871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:20.233028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:20.233695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:20.233982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:20.234260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:20.234965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] RBAC: Adding query filter params (type=image) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:20.235277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:20.236675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:20.240477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:20.241283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 509/1010] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:20.241390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:20.241390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:20.241661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:20.242361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:20.242666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:20.244104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:20.255175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 502/1011] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:20.256398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:20.367520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f9b45-4995-47d1-9adb-e986e0fd2ca7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:20.402299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:20.402972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:20.403259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:20.403568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:20.404814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:20.405131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:20.406513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c20bcf5-f388-44ad-9cc8-fd82594b8b61 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:20.411536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 510/1012] 10.222.0.25 () {56 vars in 1112 bytes} [Wed Jul 6 13:35:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:20.417374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:20.500573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:20.522854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856852b0-739a-49c7-aaaa-a7ea61ad9875 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:20.556540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccf13c-79dc-4693-aad6-7c7180c7be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:20.557203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf13c-79dc-4693-aad6-7c7180c7be10 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:20.557488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf13c-79dc-4693-aad6-7c7180c7be10 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:20.557762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccf13c-79dc-4693-aad6-7c7180c7be10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:20.558510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf13c-79dc-4693-aad6-7c7180c7be10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:20.559937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ccf13c-79dc-4693-aad6-7c7180c7be10 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:20.581104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 503/1013] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:35:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:35:21.478932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bb39f-3263-4de5-8935-6330e075a70d None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:21.479478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bb39f-3263-4de5-8935-6330e075a70d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:21.479582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1bb39f-3263-4de5-8935-6330e075a70d None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:21.480912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 511/1014] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:21.486513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:21.486909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:21.487085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:21.503956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:21.505116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:21.574460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 504/1015] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:21.597232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bb39f-3263-4de5-8935-6330e075a70d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:21.647043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:21.698637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1bb39f-3263-4de5-8935-6330e075a70d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:21.735931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6321b-8818-4748-90fa-f27ab0c87dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:21.736658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6321b-8818-4748-90fa-f27ab0c87dbf None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:21.736946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6321b-8818-4748-90fa-f27ab0c87dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:21.737225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6321b-8818-4748-90fa-f27ab0c87dbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:21.738400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6321b-8818-4748-90fa-f27ab0c87dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:21.739872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f6321b-8818-4748-90fa-f27ab0c87dbf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:21.741653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 512/1016] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:21.747083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:21.813963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:21.855042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5385c-ced7-4b43-82a8-16f0b6769cb1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:21.888041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f3209-c744-4a89-bbc1-9264eeaf11fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:21.888729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3209-c744-4a89-bbc1-9264eeaf11fb None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:21.889010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3209-c744-4a89-bbc1-9264eeaf11fb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:21.889279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f3209-c744-4a89-bbc1-9264eeaf11fb None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:21.889989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f3209-c744-4a89-bbc1-9264eeaf11fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:21.891432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f3209-c744-4a89-bbc1-9264eeaf11fb None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:21.923342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 505/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:21 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:22.289206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1992e-fe9e-439e-a9da-f18d152384d6 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:22.289583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1992e-fe9e-439e-a9da-f18d152384d6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:22.289803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1992e-fe9e-439e-a9da-f18d152384d6 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:22.291165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 513/1018] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:22.296502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a6ac-aba3-4992-85b4-0f1850c0a4c1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:22.296801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a6ac-aba3-4992-85b4-0f1850c0a4c1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:22.297083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f5a6ac-aba3-4992-85b4-0f1850c0a4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:22.313655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b8f5a6ac-aba3-4992-85b4-0f1850c0a4c1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:22.314843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b8f5a6ac-aba3-4992-85b4-0f1850c0a4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:22.381292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 506/1019] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:22.404807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1992e-fe9e-439e-a9da-f18d152384d6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:22.507100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1992e-fe9e-439e-a9da-f18d152384d6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:22.524700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:22.543695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d49c3-24e4-4715-b0b9-04d317e6dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:22.544293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d49c3-24e4-4715-b0b9-04d317e6dbb3 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:22.544604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d49c3-24e4-4715-b0b9-04d317e6dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:22.544883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d49c3-24e4-4715-b0b9-04d317e6dbb3 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:22.545606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d49c3-24e4-4715-b0b9-04d317e6dbb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:22.546974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d49c3-24e4-4715-b0b9-04d317e6dbb3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:22.567365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 514/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:22 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:22.701938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891890-ba4d-40df-b78a-3ef737399ac3 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:22.702450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891890-ba4d-40df-b78a-3ef737399ac3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:22.702526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b891890-ba4d-40df-b78a-3ef737399ac3 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:22.704072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 507/1021] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:22.709121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:22.709424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:22.709709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:22.726605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:22.727826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:22.811354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 515/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:22.832118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891890-ba4d-40df-b78a-3ef737399ac3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:22.877376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:22.938517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b891890-ba4d-40df-b78a-3ef737399ac3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:22.971889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:22.972696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:22.972977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:22.973247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:22.983832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:22.991975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:22.992887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:22.993777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 508/1023] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 13:35:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:23.001681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:23.104171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb49bc4-0d41-4b28-8f0d-141164a0ce14 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:23.105698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:23.141288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:23.141964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.142256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.142535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.143283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:23.143622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:23.144997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:23.153192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 516/1024] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:35:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:23.158754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:23.259555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a7af3-977d-409f-ad38-c93d6bda9282 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:23.261048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:23.293870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:23.295205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.295525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.295797 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.306480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:23.308004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:23.324722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:23.325601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:23.331193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:23.331193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:23.331193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:23.331193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:23.331193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 509/1025] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:23.333255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:23.438722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521bdb-138a-41af-bf12-824a87d80527 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:23.474497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:23.475150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.475459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.475733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.476438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:23.476743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:23.478098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:23.495416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 517/1026] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:23.497602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:23.595589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da8063-f24a-45c1-840f-e5e1362602f3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:23.628690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:23.629475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.629757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.630029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.637701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:23.639692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:23.653465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:23.654986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:23.660577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 510/1027] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:35:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:23.662609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:23.688202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:23.767362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144aa0f-e062-4806-a736-6fd6b3a76c1c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:23.810038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:23.810723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.811010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.811290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.812158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:23.812469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:23.813911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfb6e7-4e34-4eba-9c31-dde7827f01d0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:23.832187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 518/1028] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:35:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:23.837735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:23.855558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:23.939959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f8e54-20d4-432f-8f4d-25d68794912d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:23.973266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:23.973916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.974201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.974477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.983030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d4f3-ee6a-4550-ade9-cde63c3c89ed None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.983345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d4f3-ee6a-4550-ade9-cde63c3c89ed None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.983649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2d4f3-ee6a-4550-ade9-cde63c3c89ed None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:23.984987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 519/1029] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:23.989685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:23.989975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:23.990257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.006553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:24.007749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:24.058931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.061347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.078374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 520/1030] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:24.078869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.103045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.116929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.177578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 511/1031] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:24.179998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.210826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7477ce90-6866-45dd-a8cd-fdb44c1d4a0f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.247919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.248722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.249023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.249270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.250434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.251897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.253713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 521/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:24.258909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.285138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0faa5-3c6c-4f02-846f-c5e5993aba45 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.302303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.325121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.326406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.326698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.326960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.337186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.338889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.347656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:24.356635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:24.357561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:24.359197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:24.359197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:24.359197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:24.359197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:24.359197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 512/1033] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:24.363339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.369512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba723d93-3334-4c1d-a78e-da80bb4795c8 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.406269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.406946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.407234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.407561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.408263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.409691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.431503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 522/1034] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:35:24 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:35:24.478658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f9f02-4a47-4282-b877-1da8243f88f6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.516570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.517259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.517546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.517821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.518564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:24.518872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.520279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51621638-1fcb-4035-b70b-3959fe04904b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.533176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 513/1035] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:24.538578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.633129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18826-a0c5-4070-aa60-773f5740469f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.633327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18826-a0c5-4070-aa60-773f5740469f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.633605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f18826-a0c5-4070-aa60-773f5740469f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.635271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 514/1036] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:24.640047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.640331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.640612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.647125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d151b0e4-31ad-4cef-8a03-ed1eb4c07833 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.659446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:24.660727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:24.686892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.688499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.689471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.689802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.690128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.693073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.697993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.700220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:24.716419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:24.717343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:24.718212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 523/1037] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:24.723360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.741062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 515/1038] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:24.764039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.834536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e780ef2-87fb-4a8a-bc3d-957011771f79 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.874564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.875234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.875540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.875818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.876604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:24.876912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.877911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5634-6366-46bd-9471-0f5b55634522 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:24.878355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.895556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 524/1039] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:24.897024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.913667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:24.914509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:24.914796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:24.915067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] PATH_INFO: `/v3/services/image` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:24.915758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:24.917402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:24.930257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:24.931240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:24.932151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 516/1040] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:24.937307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:24.962636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:24.962849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:25.009643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22bb787-0810-4235-b8cc-2e4b38de402d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:25.045741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:25.046393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:25.046673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:25.046945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:25.047813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] RBAC: Adding query filter params (role.id=2e615436f119421aab3bd3328b026a6b, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=943294440c3a4d309ff6e6165dcb9d32) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:25.048125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:25.049205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20525e7-48e0-463f-b6b9-359f14f9767c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:25.049544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:25.063353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 525/1041] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/role_assignments?user.id=943294440c3a4d309ff6e6165dcb9d32&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=2e615436f119421aab3bd3328b026a6b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:25.094771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:25.095474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:25.095757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:25.096029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:25.096744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] RBAC: Adding query filter params (name=image) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:25.097047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:25.098415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:25.104015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 517/1042] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:25.110632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:25.221996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18a536-5411-4c02-8449-73b85805a3e5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:25.242807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:25.257640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:25.258305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:25.258585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:25.258856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:25.259601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] RBAC: Adding query filter params (type=image) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:25.259908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:25.261267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:25.271456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 526/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:25.272970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:25.358677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:25.375260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e605cf-54c3-46da-9d10-a3f6918bc975 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:25.408534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:25.409184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:25.409464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:25.409734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:25.410516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] RBAC: Adding query filter params (interface=public, service_id=d304634e361042de82e188b7245647c5, region_id=RegionOne) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:25.410824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:25.412198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b794b9b-283b-4dc8-b361-605ce6c919a7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:25.417250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 518/1044] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:35:25 2022] GET /identity/v3/endpoints?service_id=d304634e361042de82e188b7245647c5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:25.422636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:25.527357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fc1d1-a32d-433a-a7b0-fdc73281a9db None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:25.561375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dec129-e471-4f47-a080-c42406c76246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:25.562046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dec129-e471-4f47-a080-c42406c76246 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:25.562335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dec129-e471-4f47-a080-c42406c76246 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:25.562614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dec129-e471-4f47-a080-c42406c76246 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:25.563396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dec129-e471-4f47-a080-c42406c76246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:25.564841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dec129-e471-4f47-a080-c42406c76246 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:25.579349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 527/1045] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:35:25 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:35:26.600325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3427-3dbe-4dd8-abb2-47d3f796b580 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:26.601095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3427-3dbe-4dd8-abb2-47d3f796b580 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:26.601205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c3427-3dbe-4dd8-abb2-47d3f796b580 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:26.603458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 519/1046] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:26.609316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:26.609735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:26.609920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:26.626754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:26.627965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:26.672040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:26.702032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 528/1047] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:26.725705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3427-3dbe-4dd8-abb2-47d3f796b580 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:26.838766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c3427-3dbe-4dd8-abb2-47d3f796b580 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:26.875391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:26.876115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:26.876399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:26.876674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:26.887117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:26.895821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:26.896774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:26.902662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 520/1048] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:26.906201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.004055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085500b-9c11-4b8a-9ec5-331c3c4dbbc4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.040511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.041180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.041463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.041737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.042480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:27.042784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.044180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04a21b-61af-47d9-a4a8-5c51f0b0a698 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.052632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 529/1049] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:27.058554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.070493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.079262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f191b43-f17b-4063-96f3-ad016dd5db8c None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.079587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f191b43-f17b-4063-96f3-ad016dd5db8c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.079868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f191b43-f17b-4063-96f3-ad016dd5db8c None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.081375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 530/1050] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:27.085999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.086290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.086566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.103082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:27.104279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:27.143530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.168540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026ffad-4554-4034-a08c-c79d78c4fea6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.177026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 531/1051] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:27.199944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.206495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.207400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.207686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.207960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] PATH_INFO: `/v3/users/e3dbb7a3a29a4c8183afb00d810ee23d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.222463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] RBAC: Authorizing `identity:get_user(user_id=e3dbb7a3a29a4c8183afb00d810ee23d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.224436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.226165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 521/1052] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/users/e3dbb7a3a29a4c8183afb00d810ee23d => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:27.231692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.300850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.315219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47393fd-73cc-4ce2-b076-41cfb41aca49 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.339080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3b1d-2de1-4382-8443-69b1894121cb None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.351618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.352436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.352830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.353108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.364146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:27.373219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:27.373355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:27.374237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:27.380090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:27.380761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.380761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.380761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.380939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 532/1053] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:27.380939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.413486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.453217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.454664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.488141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074a41b4-a7a4-4de3-aed7-a3c296ec8f51 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.522350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.523029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.523335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.523636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.524391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:27.524703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.526089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.527603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.535342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 533/1054] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:27.540685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.574654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 522/1055] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:27.580209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.637334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.646376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400e476-8cee-4fc0-96ff-143016472244 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.678058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa16e73-2ae0-49f7-8eed-9b6ecf93e198 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.679924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.680721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.681004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.681283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.692286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.693732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-ccafb2eb-0e1c-473e-bd4c-69624372456e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:27.710722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:27.711832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:27.713175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:27.713175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:27.713175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:27.713175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:27.713175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 534/1056] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:27.713513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00fe6-4459-410a-8e74-d48d01223c8f None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.713706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00fe6-4459-410a-8e74-d48d01223c8f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.713988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f00fe6-4459-410a-8e74-d48d01223c8f None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.714267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f2268-a124-4cdf-893c-9d2d4eecdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.715113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f2268-a124-4cdf-893c-9d2d4eecdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.715549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 535/1057] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:27.717835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f00fe6-4459-410a-8e74-d48d01223c8f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.719227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f2268-a124-4cdf-893c-9d2d4eecdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.719546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f2268-a124-4cdf-893c-9d2d4eecdcf2 None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.720763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f2268-a124-4cdf-893c-9d2d4eecdcf2 None admin] RBAC: Authorizing `identity:get_project(project_id=addf1273905e4d809dadc3308ab9c437)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.722184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f2268-a124-4cdf-893c-9d2d4eecdcf2 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.728623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 523/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/projects/addf1273905e4d809dadc3308ab9c437 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:27.728623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.728623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.728623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.742289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:27.743493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:27.769101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.812783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 524/1059] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:27.813618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.828025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f00fe6-4459-410a-8e74-d48d01223c8f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.863378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.864035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.864324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.864601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.865312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:27.865621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.866986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.878238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 536/1060] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:27.879121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.884600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:27.914007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cf82d-b22f-4647-b362-471d2c5d97c7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.947539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:27.948125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:27.948412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:27.948687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:27.949544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=addf1273905e4d809dadc3308ab9c437, user.id=e3dbb7a3a29a4c8183afb00d810ee23d) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:27.949856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:27.951335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:27.956585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 525/1061] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/role_assignments?user.id=e3dbb7a3a29a4c8183afb00d810ee23d&scope.project.id=addf1273905e4d809dadc3308ab9c437&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:27.957357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:27.980720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de73c9a-02e8-49e5-aaab-29d8fe68d8c6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:27.995815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.023672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.024522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.024809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.025089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] PATH_INFO: `/v3/services/image` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.025760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.027184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:28.040724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:28.041791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 13:35:28.042609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:28.047495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 537/1062] 10.222.0.25 () {56 vars in 1105 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:28.048771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.073207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef51ed-0cf0-4dd7-a5f3-8fd52482475a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.109629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.110666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.111119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.111620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.119526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.121124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.126209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:28.135808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:28.136936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:35:28.138620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:28.145487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 526/1063] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:35:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:28.146658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.165928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2df56-c30e-4920-9df8-c43ba3eb3727 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.201797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.202381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.202668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.202947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.203682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] RBAC: Adding query filter params (name=image) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:28.203993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.205366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.210761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 538/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:28.216971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.243919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.257503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858db3e-6111-45e1-8bac-b526e4e1ac2d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.292980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.293650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.293930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.294234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.295256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:28.295607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.297172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.318718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 527/1065] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:28.319971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45abdc20-eb74-44f6-9964-2d42a6a85308 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.324098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.353001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.359714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.360376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.360660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.360937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.361636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] RBAC: Adding query filter params (type=image) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:28.361935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.363357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.372900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 539/1066] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:28.373882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.439508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad3f31f-eb8d-498d-9a2d-30f9cb42d516 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.475704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.476408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.476873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.476985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.482623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e8c5a-dc94-4634-85ad-2124f24d6e31 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.487625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.489067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.496421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:28.509534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:28.510458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:28.511395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:28.511395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:28.511395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:28.511395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:28.511395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 528/1067] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:28.516827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.521016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.521214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.521474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.521754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.522488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.523896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.543806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 540/1068] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:35:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:28.634682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaec9d86-4838-4904-85f8-8821ab4a669e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.679154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.680607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.680896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.681173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.681909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:28.682215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.683666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.700258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 529/1069] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:28.702927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.758989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.814600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d0cd4-b5d2-427b-a55e-23aff75ffaaf None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:28.849456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:28.850245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:28.850528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:28.850801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:28.857635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:28.859073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:28.873745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:28.874712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:28.875991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:28.876613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 541/1070] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:28.880981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:28.938220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:28.983498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4834-4caa-41a3-858c-695bbf6c5d5f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:29.016798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:29.017384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:29.017667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:29.017941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:29.018729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:29.019038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:29.020505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b448c6-fb1e-4fdd-80d7-e72af57ac483 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:29.034342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 530/1071] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:29.040446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:29.145629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5b2b5-e3c7-4440-8030-cc941c87008d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:29.158638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:29.180904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e4aea-d542-449f-bef8-f0469ee5c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:29.181794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e4aea-d542-449f-bef8-f0469ee5c5f0 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:29.182081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e4aea-d542-449f-bef8-f0469ee5c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:29.182361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e4aea-d542-449f-bef8-f0469ee5c5f0 None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/943294440c3a4d309ff6e6165dcb9d32/roles/2e615436f119421aab3bd3328b026a6b` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:29.184590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e4aea-d542-449f-bef8-f0469ee5c5f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=943294440c3a4d309ff6e6165dcb9d32, role_id=2e615436f119421aab3bd3328b026a6b)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:29.186611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e4aea-d542-449f-bef8-f0469ee5c5f0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:29.199843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 542/1072] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:35:29 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/943294440c3a4d309ff6e6165dcb9d32/roles/2e615436f119421aab3bd3328b026a6b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:35:29.988766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee5f16-da15-48ad-ab56-fcd25dbfadb9 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:29.989318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee5f16-da15-48ad-ab56-fcd25dbfadb9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:29.989318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee5f16-da15-48ad-ab56-fcd25dbfadb9 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:29.990796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 531/1073] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:29.995813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:29.996239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:29.996383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.013667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:30.014839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:30.080436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 543/1074] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:30.103034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee5f16-da15-48ad-ab56-fcd25dbfadb9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:30.206670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee5f16-da15-48ad-ab56-fcd25dbfadb9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:30.221212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:30.241886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:30.242674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.242955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.243228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.253222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:30.260787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:30.261741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:30.262566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:30.267217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 532/1075] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:30.268079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:30.372872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e0664-a2f4-49b9-b59a-e7ce6488346d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:30.374425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:30.409952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:30.410617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.410899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.411170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.411934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:30.412237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:30.413591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:30.422031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 544/1076] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:30.427439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:30.525935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f1545-b9e0-464a-8313-e348d1f6bf58 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:30.558188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a20e93f-1d10-4cb1-98f8-24f07e2df421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:30.559048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e93f-1d10-4cb1-98f8-24f07e2df421 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.559338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e93f-1d10-4cb1-98f8-24f07e2df421 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.559628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20e93f-1d10-4cb1-98f8-24f07e2df421 None admin] PATH_INFO: `/v3/users/e3dbb7a3a29a4c8183afb00d810ee23d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.560815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e93f-1d10-4cb1-98f8-24f07e2df421 None admin] RBAC: Authorizing `identity:get_user(user_id=e3dbb7a3a29a4c8183afb00d810ee23d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:30.562241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a20e93f-1d10-4cb1-98f8-24f07e2df421 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:30.564077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 533/1077] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:30 2022] GET /identity/v3/users/e3dbb7a3a29a4c8183afb00d810ee23d => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:30.569524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:30.626488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285448-6fd4-46d4-b965-233ab65b3201 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.626764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285448-6fd4-46d4-b965-233ab65b3201 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.626963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285448-6fd4-46d4-b965-233ab65b3201 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.628575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 534/1078] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:30.633607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.633899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.634174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.651538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:30.652721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:30.669973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db1d13-9c4d-4da6-80c6-ab80b4a17bf6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:30.688232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:30.704779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:30.705643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.705966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.706195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.707385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] RBAC: Authorizing `identity:get_project(project_id=addf1273905e4d809dadc3308ab9c437)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:30.708828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:30.710832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 545/1079] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:30 2022] GET /identity/v3/projects/addf1273905e4d809dadc3308ab9c437 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:30.717428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:30.728828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 535/1080] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:30.748495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:30.750898 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:30.822578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e293a-962b-46db-a1ae-04f8dcb3516a None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:30.857581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:30.858744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.859027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.859302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437/users/e3dbb7a3a29a4c8183afb00d810ee23d/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.859437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626047a-50ed-431a-b202-ff0c04a9c8f3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:30.861269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] RBAC: Authorizing `identity:create_grant(project_id=addf1273905e4d809dadc3308ab9c437, user_id=e3dbb7a3a29a4c8183afb00d810ee23d, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:30.862719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:30.880375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 546/1081] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:35:30 2022] PUT /identity/v3/projects/addf1273905e4d809dadc3308ab9c437/users/e3dbb7a3a29a4c8183afb00d810ee23d/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:35:30.899182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf9571-24f4-4877-a519-0838c2e72762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:30.899890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf9571-24f4-4877-a519-0838c2e72762 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:30.900176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf9571-24f4-4877-a519-0838c2e72762 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:30.900451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf9571-24f4-4877-a519-0838c2e72762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:30.947117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:30.977685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf9571-24f4-4877-a519-0838c2e72762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:30.979155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf9571-24f4-4877-a519-0838c2e72762 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:31.087416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 536/1082] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 13:35:31.093542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:31.186838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:31.197537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa19b00-c068-4af6-83d9-32a5130dd29f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:31.232285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:31.233082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.233369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.233643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.244436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:31.245891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:31.260841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2119-577f-4cb8-9075-84a6ac371247 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.261137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2119-577f-4cb8-9075-84a6ac371247 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.261419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a2119-577f-4cb8-9075-84a6ac371247 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.262794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 537/1083] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:31.263601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:31.264467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:31.270292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:31.270292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:31.270292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:31.270292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:31.270292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 547/1084] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:31.270585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.270585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.270585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.270771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:31.285879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:31.287303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:31.358299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 538/1085] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:31.381840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:31.382304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12d135-1188-443b-b036-5487c00bbf2d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:31.384107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:31.422588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:31.423247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.423562 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.423840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.424648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:31.424861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:31.426432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:31.439915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 548/1086] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:31.488268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2395-2abb-4cbc-88d4-6fcacc8796a3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:31.525511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:31.526333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.526611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.526881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.539012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:31.547995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:31.549038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:31.550170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 539/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Wed Jul 6 13:35:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:31.555418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:31.559524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:31.664523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a573c-30ee-401c-94e4-a51bec69cd9d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:31.702412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:31.703012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.703296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.703605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.704345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:31.704651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:31.706024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:31.714494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 549/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:35:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:31.720799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:31.783990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:31.824531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36122e-e9f8-4803-b6e3-dc5e96c81bec None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:31.857434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:31.858220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:31.858504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:31.858782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:31.869813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:31.871250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:31.888288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:31.889299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:31.890207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:31.890207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:31.890207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:31.890207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:31.890207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 540/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:31.895229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:31.958444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:31.994725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb70f0-7d7f-4cc0-ac00-431a9b31a484 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:32.027639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:32.028294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.029104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.029380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.030086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:32.030391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:32.031775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:32.043137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 550/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:32.048918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:32.144007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eee403-b8a8-484e-afbc-56e1b90a1f9c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:32.157402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:32.176877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:32.177703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.177986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.178260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.185697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:32.187132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:35:32.201422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:32.202503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:32.203765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 541/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Wed Jul 6 13:35:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:32.208290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:32.305368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea3362-0af6-4bb0-99c4-97d7f95eaa01 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:32.331081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:32.340693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:32.341360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.341647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.341924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.342759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:32.343069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:32.344540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:32.361312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 551/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Wed Jul 6 13:35:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:32.366969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:32.463923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa6b930-c29e-4baf-9bf5-9b4a8bc32d74 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:32.496472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:32.497643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.497928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.498200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.539130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:32.564623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:32.566011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:32.661516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 542/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 13:35:32.667179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:32.763816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a2891-d995-438e-b363-aaaf79114191 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:32.801018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:32.801812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.802097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.802382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.813509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:32.814995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-29271547-aab7-4cc1-9b27-b2799aaf7863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:35:32.832024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:32.832998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:32.833893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:35:32.833893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:35:32.833893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:35:32.833893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:32.835462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 552/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:32.839279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:32.894678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350409-b0f5-4296-b607-aa70c7de4fe7 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.894969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350409-b0f5-4296-b607-aa70c7de4fe7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.895246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350409-b0f5-4296-b607-aa70c7de4fe7 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.896767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 553/1095] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:32.901267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.901551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.901827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.911153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:32.918052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:32.919797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:32.937093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacef908-bb8d-40ed-81a0-2492ad79b26a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:32.948178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:32.969769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:32.970427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:32.970712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:32.970996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:32.971741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:32.972057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:32.973420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:32.985156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 554/1096] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:35:32.985676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 543/1097] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:32.990790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.008252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.088797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41de1d4-bcbb-4cf9-be9b-38b3ae887c28 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.105377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fbb17-aefd-4f1e-b7eb-f8e54d4c6efd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.122413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.123202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.123519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.123799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.130295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.131806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.137864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.138647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.138930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.139203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.141065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:35:33.145310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:33.146367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:33.152171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 555/1098] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:33.152697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:33.153115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:33.158500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:33.159598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:33.160435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 544/1099] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:35:33.165398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.179999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:33.252646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a3760-f5c8-4b6e-b9fa-8efa6826a4b5 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.263516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c9802-e002-421b-aafe-7f805100b8a9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.286493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.287148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.287454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.287727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.288503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:33.288811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.290243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.296847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.297509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.297794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.298069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.298809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:33.299112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.300492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.302649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 556/1100] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:33.312587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 545/1101] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:33.312756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.314543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.368955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:33.394070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:33.409612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feea609-da60-4966-af4b-c1f5eb55a27d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.412826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b7e9b-89be-413c-bc54-d120dedf1fd0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.442330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.442971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.443253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.443558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.444372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] RBAC: Adding query filter params (role.id=2e615436f119421aab3bd3328b026a6b, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=943294440c3a4d309ff6e6165dcb9d32) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:33.444668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.444790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.445519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.445798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.446068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] PATH_INFO: `/v3/users/e3dbb7a3a29a4c8183afb00d810ee23d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.446157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.447237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] RBAC: Authorizing `identity:get_user(user_id=e3dbb7a3a29a4c8183afb00d810ee23d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.448669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.451033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 546/1102] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/users/e3dbb7a3a29a4c8183afb00d810ee23d => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:33.456532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 557/1103] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/role_assignments?user.id=943294440c3a4d309ff6e6165dcb9d32&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=2e615436f119421aab3bd3328b026a6b => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:33.457792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.562121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2308d4-059b-4e85-89f2-c44befa62838 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.587288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:33.599484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.600142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.600427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.600706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.668218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.669588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.767933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 547/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:33.773992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.879284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb4568-1244-4633-8a08-59a89c1d9052 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:33.912661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c4b14-7546-44db-a44d-49ed5ecb4d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:33.913520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4b14-7546-44db-a44d-49ed5ecb4d9f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:33.913803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4b14-7546-44db-a44d-49ed5ecb4d9f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:33.914081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c4b14-7546-44db-a44d-49ed5ecb4d9f None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:33.915253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4b14-7546-44db-a44d-49ed5ecb4d9f None admin] RBAC: Authorizing `identity:get_project(project_id=addf1273905e4d809dadc3308ab9c437)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:33.916716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c4b14-7546-44db-a44d-49ed5ecb4d9f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:33.918460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 558/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/projects/addf1273905e4d809dadc3308ab9c437 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:33.924758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:33.950031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:34.025482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e565d-bb94-40e5-bbf6-fa20452a475c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:34.059067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:34.060268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:34.060551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:34.060827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:34.061655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=addf1273905e4d809dadc3308ab9c437, user.id=e3dbb7a3a29a4c8183afb00d810ee23d) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:34.061968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:34.063415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e8284-964c-4571-9c62-ca8ea09f9e2b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:34.069287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 548/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:33 2022] GET /identity/v3/role_assignments?user.id=e3dbb7a3a29a4c8183afb00d810ee23d&scope.project.id=addf1273905e4d809dadc3308ab9c437&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:36.092507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270804-63e7-4c31-b7dc-88fe79f79238 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:36.093003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270804-63e7-4c31-b7dc-88fe79f79238 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:36.093003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55270804-63e7-4c31-b7dc-88fe79f79238 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:36.094362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 559/1107] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:36.099395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:36.099785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:36.099964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:36.116065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:36.117228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:36.180691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 549/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:36.208622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55270804-63e7-4c31-b7dc-88fe79f79238 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:36.228044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:36.307440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55270804-63e7-4c31-b7dc-88fe79f79238 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:36.340776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5abd3b-0fef-4c1f-ac5e-09c5776073f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:36.341581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5abd3b-0fef-4c1f-ac5e-09c5776073f9 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:36.341869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5abd3b-0fef-4c1f-ac5e-09c5776073f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:36.342148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5abd3b-0fef-4c1f-ac5e-09c5776073f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:36.343379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5abd3b-0fef-4c1f-ac5e-09c5776073f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:36.344775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5abd3b-0fef-4c1f-ac5e-09c5776073f9 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:36.346374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 560/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:36.351973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:36.369364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:36.446349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a5044-4ea7-4d4b-9486-196777f6dabc None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:36.482072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c000af-90d2-4b4d-b1aa-40447a83f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:36.482732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c000af-90d2-4b4d-b1aa-40447a83f318 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:36.483016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c000af-90d2-4b4d-b1aa-40447a83f318 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:36.483293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c000af-90d2-4b4d-b1aa-40447a83f318 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:36.484031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c000af-90d2-4b4d-b1aa-40447a83f318 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:36.485458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c000af-90d2-4b4d-b1aa-40447a83f318 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:36.505550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 550/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:35:36 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:38.527875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dcf4-f611-4a94-9d80-a6ad473bdcc9 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:38.528421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dcf4-f611-4a94-9d80-a6ad473bdcc9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:38.528421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18dcf4-f611-4a94-9d80-a6ad473bdcc9 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:38.529802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 561/1111] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:38.534916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:38.535313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:38.535497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:38.551763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:38.552945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:38.616618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 551/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:38.640646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18dcf4-f611-4a94-9d80-a6ad473bdcc9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:38.724041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:38.739991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18dcf4-f611-4a94-9d80-a6ad473bdcc9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:38.772328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:38.773168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:38.773454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:38.773734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] PATH_INFO: `/v3/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:38.775181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] RBAC: Authorizing `identity:get_role(role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:38.776650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:38.778067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 562/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:38 2022] GET /identity/v3/roles/be9562507bd540289a07df4afd1c4cee => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:38.783797 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:38.786880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:38.880497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726ee36-6301-4ef7-b527-b5a5d2ad918d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:38.916961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:38.917825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:38.918108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:38.918385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] PATH_INFO: `/v3/users/ac8fc09c41bf43448e8b4198729d33e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:38.931371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] RBAC: Authorizing `identity:get_user(user_id=ac8fc09c41bf43448e8b4198729d33e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:38.932807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:38.934989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 552/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:38 2022] GET /identity/v3/users/ac8fc09c41bf43448e8b4198729d33e5 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:35:38.940692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:39.035498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abf1fc-292b-4a1a-a008-178d9e4d21c6 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:39.070344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:39.070975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:39.071258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:39.071561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:39.094462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:39.136197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:39.137650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:39.230946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 563/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:39.237280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:39.295594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:39.331313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e14a9-0281-4199-aeb7-5d70baa672bd None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:39.365474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27bd1b-fbe8-4ad8-9a7f-6984e372226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:39.366305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bd1b-fbe8-4ad8-9a7f-6984e372226e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:39.366584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bd1b-fbe8-4ad8-9a7f-6984e372226e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:39.366856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bd1b-fbe8-4ad8-9a7f-6984e372226e None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:39.367977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27bd1b-fbe8-4ad8-9a7f-6984e372226e None admin] RBAC: Authorizing `identity:get_project(project_id=addf1273905e4d809dadc3308ab9c437)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:39.369383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27bd1b-fbe8-4ad8-9a7f-6984e372226e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:39.371024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 553/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:39 2022] GET /identity/v3/projects/addf1273905e4d809dadc3308ab9c437 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:39.376893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:39.429354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:39.473199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f14db-25db-4f68-808c-d8e710028372 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:39.505089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:39.505720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:39.506001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:39.506275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:39.507088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] RBAC: Adding query filter params (role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=addf1273905e4d809dadc3308ab9c437, user.id=ac8fc09c41bf43448e8b4198729d33e5) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:39.507427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:39.508843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8ade5-ce8d-485c-a0dd-af39b323910b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:39.514596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 564/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:39 2022] GET /identity/v3/role_assignments?user.id=ac8fc09c41bf43448e8b4198729d33e5&scope.project.id=addf1273905e4d809dadc3308ab9c437&role.id=be9562507bd540289a07df4afd1c4cee => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:41.483615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06ffc-23e5-4da1-86a8-3087770fd35b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:41.484138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06ffc-23e5-4da1-86a8-3087770fd35b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:41.484138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06ffc-23e5-4da1-86a8-3087770fd35b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:41.485504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 554/1118] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:41.490594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:41.490993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:41.491183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:41.508162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:41.509333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:41.572937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 565/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:41.595735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06ffc-23e5-4da1-86a8-3087770fd35b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:41.691551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06ffc-23e5-4da1-86a8-3087770fd35b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:41.717960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:41.723854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:41.724705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:41.724993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:41.725270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] PATH_INFO: `/v3/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:41.726737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] RBAC: Authorizing `identity:get_role(role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:41.728142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:41.729495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 555/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:41 2022] GET /identity/v3/roles/be9562507bd540289a07df4afd1c4cee => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:41.735613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:41.781884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:41.831371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12741cdd-c102-49a2-9717-680c7e74eeaa None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:41.871612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:41.873021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:41.873297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:41.873569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] PATH_INFO: `/v3/users/ac8fc09c41bf43448e8b4198729d33e5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:41.874737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] RBAC: Authorizing `identity:get_user(user_id=ac8fc09c41bf43448e8b4198729d33e5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:41.876186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:41.877806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 566/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:41 2022] GET /identity/v3/users/ac8fc09c41bf43448e8b4198729d33e5 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:41.883629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:41.977159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3994a32-edab-4763-a14f-5572294adfb4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:42.009209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec754b1-11a9-4aff-99b5-9767fa38ad08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:42.009985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec754b1-11a9-4aff-99b5-9767fa38ad08 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:42.010265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec754b1-11a9-4aff-99b5-9767fa38ad08 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:42.010537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec754b1-11a9-4aff-99b5-9767fa38ad08 None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:42.011713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec754b1-11a9-4aff-99b5-9767fa38ad08 None admin] RBAC: Authorizing `identity:get_project(project_id=addf1273905e4d809dadc3308ab9c437)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:42.013153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec754b1-11a9-4aff-99b5-9767fa38ad08 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:42.014788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 556/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:41 2022] GET /identity/v3/projects/addf1273905e4d809dadc3308ab9c437 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:42.020566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:42.115404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29283d62-9707-47eb-aa2e-e27d4f20a5ea None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:42.130804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:42.150069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8baf3c-33a8-4be2-896a-26fe99ae63e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:42.150948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8baf3c-33a8-4be2-896a-26fe99ae63e3 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:42.151230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8baf3c-33a8-4be2-896a-26fe99ae63e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:42.151543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8baf3c-33a8-4be2-896a-26fe99ae63e3 None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437/users/ac8fc09c41bf43448e8b4198729d33e5/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:42.154211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8baf3c-33a8-4be2-896a-26fe99ae63e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=addf1273905e4d809dadc3308ab9c437, user_id=ac8fc09c41bf43448e8b4198729d33e5, role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:42.155677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8baf3c-33a8-4be2-896a-26fe99ae63e3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:42.168036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 567/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:35:42 2022] PUT /identity/v3/projects/addf1273905e4d809dadc3308ab9c437/users/ac8fc09c41bf43448e8b4198729d33e5/roles/be9562507bd540289a07df4afd1c4cee => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:35:44.144564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22358d7-86dc-4dc8-8c16-125ba9433c36 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:44.145171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22358d7-86dc-4dc8-8c16-125ba9433c36 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:44.145171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22358d7-86dc-4dc8-8c16-125ba9433c36 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:44.146378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 557/1124] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:44.151737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:44.152121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:44.152302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:44.169169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:44.170354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:44.236024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 568/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:44.258802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22358d7-86dc-4dc8-8c16-125ba9433c36 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:44.322774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:44.357894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22358d7-86dc-4dc8-8c16-125ba9433c36 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:44.390506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:44.391361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:44.391643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:44.391914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] PATH_INFO: `/v3/roles/be9562507bd540289a07df4afd1c4cee` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:44.393345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] RBAC: Authorizing `identity:get_role(role_id=be9562507bd540289a07df4afd1c4cee)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:44.394749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:44.396065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 558/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:44 2022] GET /identity/v3/roles/be9562507bd540289a07df4afd1c4cee => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:44.401709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:44.497140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7b556-c8af-46ad-bf1c-314f37909b38 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:44.504229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:44.531144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:44.532037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:44.532328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:44.532610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] PATH_INFO: `/v3/users/ac8fc09c41bf43448e8b4198729d33e5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:44.533780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] RBAC: Authorizing `identity:get_user(user_id=ac8fc09c41bf43448e8b4198729d33e5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:44.535210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:44.536846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 569/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:44 2022] GET /identity/v3/users/ac8fc09c41bf43448e8b4198729d33e5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:44.542561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:44.637950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fe213-3598-40db-8863-8dc804ee1eaa None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:44.670215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:44.670791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:44.671076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:44.671388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:44.674013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:44.736245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:44.737676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:44.831567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 559/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:44.837435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:44.932316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d1ce4-f05d-4c2f-a647-753ba478e528 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:44.964284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d50ec9-427c-4e32-bb07-7d36f8b1cdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:44.965122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50ec9-427c-4e32-bb07-7d36f8b1cdb0 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:44.965425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50ec9-427c-4e32-bb07-7d36f8b1cdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:44.965696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d50ec9-427c-4e32-bb07-7d36f8b1cdb0 None admin] PATH_INFO: `/v3/projects/addf1273905e4d809dadc3308ab9c437` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:44.966846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d50ec9-427c-4e32-bb07-7d36f8b1cdb0 None admin] RBAC: Authorizing `identity:get_project(project_id=addf1273905e4d809dadc3308ab9c437)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:44.968291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d50ec9-427c-4e32-bb07-7d36f8b1cdb0 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:44.969933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 570/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:44 2022] GET /identity/v3/projects/addf1273905e4d809dadc3308ab9c437 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:44.975779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:45.008512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:45.072296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882f937-c488-44bf-85fe-8eaedfc3e72d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:45.105296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:45.105939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:45.106836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:45.107116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:45.107975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] RBAC: Adding query filter params (role.id=be9562507bd540289a07df4afd1c4cee, scope.project.id=addf1273905e4d809dadc3308ab9c437, user.id=ac8fc09c41bf43448e8b4198729d33e5) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:45.108290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:45.109742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdd896-2dc9-4d40-8a5d-d9328f726879 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:45.115402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 560/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:44 2022] GET /identity/v3/role_assignments?user.id=ac8fc09c41bf43448e8b4198729d33e5&scope.project.id=addf1273905e4d809dadc3308ab9c437&role.id=be9562507bd540289a07df4afd1c4cee => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:47.150910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd109-2068-4b24-aa00-4f6a6adb8cf1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:47.151443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd109-2068-4b24-aa00-4f6a6adb8cf1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:47.151443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd109-2068-4b24-aa00-4f6a6adb8cf1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:47.152779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 571/1131] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:47.158310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:47.158749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:47.158872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:47.174974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:47.176170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:47.239030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 561/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:47.261885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafd109-2068-4b24-aa00-4f6a6adb8cf1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:47.305239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:47.361670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafd109-2068-4b24-aa00-4f6a6adb8cf1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:47.393464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a10a0-0cc2-4675-ada9-32d949492273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:47.394235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a10a0-0cc2-4675-ada9-32d949492273 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:47.394518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a10a0-0cc2-4675-ada9-32d949492273 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:47.394792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a10a0-0cc2-4675-ada9-32d949492273 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:47.395966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a10a0-0cc2-4675-ada9-32d949492273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:47.397395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a10a0-0cc2-4675-ada9-32d949492273 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:47.398975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 572/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:47.405281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:47.431235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:47.502472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5e8e3-a0c8-44b0-9d09-e37039a57746 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:47.534980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39690a8a-2cf7-4c99-943a-97bc132b0f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:47.535656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39690a8a-2cf7-4c99-943a-97bc132b0f57 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:47.535946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39690a8a-2cf7-4c99-943a-97bc132b0f57 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:47.536226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39690a8a-2cf7-4c99-943a-97bc132b0f57 None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:47.536928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39690a8a-2cf7-4c99-943a-97bc132b0f57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:47.538347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39690a8a-2cf7-4c99-943a-97bc132b0f57 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:47.562807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 562/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:35:47 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:49.660440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b8a8-85e5-42bc-927a-30cffb23b3cb None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:49.660995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b8a8-85e5-42bc-927a-30cffb23b3cb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:49.660995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b8a8-85e5-42bc-927a-30cffb23b3cb None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:49.662354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 573/1135] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:49.667578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:49.667959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:49.668148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:49.685400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:49.686596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:49.750446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 563/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:49.774421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b8a8-85e5-42bc-927a-30cffb23b3cb None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:49.879288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b8a8-85e5-42bc-927a-30cffb23b3cb None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:49.890362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:49.914105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716d39a-3767-4135-9479-37849a090a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:49.914832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716d39a-3767-4135-9479-37849a090a23 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:49.915120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716d39a-3767-4135-9479-37849a090a23 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:49.915428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716d39a-3767-4135-9479-37849a090a23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:49.916594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716d39a-3767-4135-9479-37849a090a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:49.918038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716d39a-3767-4135-9479-37849a090a23 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:49.919700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 574/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:49.925476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:49.936629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:50.023439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867403ea-e1f5-4f42-a85d-292b280b24b7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:50.055939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fd284-e1b1-44e4-98f1-b004f787e0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:50.056606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd284-e1b1-44e4-98f1-b004f787e0ef None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:50.056894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd284-e1b1-44e4-98f1-b004f787e0ef None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:50.057170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fd284-e1b1-44e4-98f1-b004f787e0ef None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:50.057883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fd284-e1b1-44e4-98f1-b004f787e0ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:50.059311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fd284-e1b1-44e4-98f1-b004f787e0ef None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:50.078373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 564/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:35:49 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:35:52.130202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271404-10b9-4b1a-bb23-34e7de0ea355 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:52.130722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271404-10b9-4b1a-bb23-34e7de0ea355 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:52.130722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74271404-10b9-4b1a-bb23-34e7de0ea355 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:52.132089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 575/1139] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:52.137858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:52.138294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:52.138418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:52.154685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:52.155889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:52.213548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:52.221400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 565/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:52.244377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74271404-10b9-4b1a-bb23-34e7de0ea355 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:52.342189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74271404-10b9-4b1a-bb23-34e7de0ea355 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:52.375237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:52.376049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:52.376333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:52.376606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:52.386438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:52.393992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:52.395150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:52.396134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 576/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:52.401213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:52.495716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928bafc-1ca7-48e1-8306-67a05e3d52a4 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:52.528482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:52.529144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:52.529429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:52.529706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:52.530451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:52.530760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:52.532152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:52.540078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 566/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:52.546300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:52.584604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:52.642066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a254d6d-ef7c-4192-8576-f63186d815a3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:52.675246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:52.676124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:52.676405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:52.676678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] PATH_INFO: `/v3/users/7fde5b91d98142f4a678af1a7e4a51b5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:52.689240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] RBAC: Authorizing `identity:get_user(user_id=7fde5b91d98142f4a678af1a7e4a51b5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:52.690666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:52.692310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 577/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:52 2022] GET /identity/v3/users/7fde5b91d98142f4a678af1a7e4a51b5 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:52.697850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:52.754213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:52.795065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d87ec0-a4b7-46a1-84c7-f5d12b43bf16 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:52.826954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:52.827630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:52.827918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:52.828194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:52.892816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:52.894204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:52.947527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:52.988562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 567/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:52.994322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:53.083926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:53.089922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6c79e-0a87-49e4-aba7-eaaa1d63df19 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:53.122083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a9e5f-22e6-4c36-8f30-3481c56baecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:53.122920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9e5f-22e6-4c36-8f30-3481c56baecc None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:53.123202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9e5f-22e6-4c36-8f30-3481c56baecc None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:53.123506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9e5f-22e6-4c36-8f30-3481c56baecc None admin] PATH_INFO: `/v3/projects/6afb6e26bb63497581bb7d62b71b718e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:53.124657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a9e5f-22e6-4c36-8f30-3481c56baecc None admin] RBAC: Authorizing `identity:get_project(project_id=6afb6e26bb63497581bb7d62b71b718e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:53.126072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a9e5f-22e6-4c36-8f30-3481c56baecc None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:53.127908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 578/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:52 2022] GET /identity/v3/projects/6afb6e26bb63497581bb7d62b71b718e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:53.133777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:53.228561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d188f1-8f3e-4908-a0d7-78cfcf6e6fbc None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:53.260172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:53.260806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:53.261087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:53.261370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:53.262707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=6afb6e26bb63497581bb7d62b71b718e, user.id=7fde5b91d98142f4a678af1a7e4a51b5) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:53.263019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:53.264463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35896f98-5e14-44c2-ad52-1438e885e98e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:53.269609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 568/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:53 2022] GET /identity/v3/role_assignments?user.id=7fde5b91d98142f4a678af1a7e4a51b5&scope.project.id=6afb6e26bb63497581bb7d62b71b718e&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:55.226501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fcbf3-1106-49df-982d-9772a673a3c6 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:55.227009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fcbf3-1106-49df-982d-9772a673a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:55.227009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365fcbf3-1106-49df-982d-9772a673a3c6 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:55.228388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 579/1147] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:55.234060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:55.234487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:55.234599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:55.251500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:55.252679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:55.268466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:55.316520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 569/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:55.338467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fcbf3-1106-49df-982d-9772a673a3c6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:55.436278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365fcbf3-1106-49df-982d-9772a673a3c6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:55.468318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:55.469115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:55.469400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:55.469677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:55.479482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:55.487557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:55.488681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:35:55.489814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 580/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:55.494695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:55.592066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b44df-2547-4786-9d19-e6468d510509 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:55.624236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:55.624896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:55.625181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:55.625460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:55.626200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:55.626507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:55.627946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:55.635682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 570/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:55.641414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:55.667170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:55.739075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b892ca5d-2638-4ac0-b056-945bbda98dc4 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:55.770200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:55.771049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:55.771351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:55.771632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] PATH_INFO: `/v3/users/7fde5b91d98142f4a678af1a7e4a51b5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:55.772788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] RBAC: Authorizing `identity:get_user(user_id=7fde5b91d98142f4a678af1a7e4a51b5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:55.774199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:55.775827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 581/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:55 2022] GET /identity/v3/users/7fde5b91d98142f4a678af1a7e4a51b5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:55.782076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:55.798153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:55.880171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10a5fc-c67c-49b8-bba2-e5b6a4d27361 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:55.912425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbab474-6624-4f5d-8355-ffae43d2bb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:55.913277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab474-6624-4f5d-8355-ffae43d2bb6d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:55.913557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab474-6624-4f5d-8355-ffae43d2bb6d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:55.913828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbab474-6624-4f5d-8355-ffae43d2bb6d None admin] PATH_INFO: `/v3/projects/6afb6e26bb63497581bb7d62b71b718e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:55.914979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbab474-6624-4f5d-8355-ffae43d2bb6d None admin] RBAC: Authorizing `identity:get_project(project_id=6afb6e26bb63497581bb7d62b71b718e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:55.916427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbab474-6624-4f5d-8355-ffae43d2bb6d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:55.918085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 571/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:55 2022] GET /identity/v3/projects/6afb6e26bb63497581bb7d62b71b718e => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:55.925218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:56.013881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:56.022648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd380560-c6ce-499e-8cd6-5bf5349c3cc2 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:56.055235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fc7c3-01f5-4678-a020-b354678b7432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:56.056205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc7c3-01f5-4678-a020-b354678b7432 None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:56.056486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc7c3-01f5-4678-a020-b354678b7432 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:56.056762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc7c3-01f5-4678-a020-b354678b7432 None admin] PATH_INFO: `/v3/projects/6afb6e26bb63497581bb7d62b71b718e/users/7fde5b91d98142f4a678af1a7e4a51b5/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:56.058661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fc7c3-01f5-4678-a020-b354678b7432 None admin] RBAC: Authorizing `identity:create_grant(project_id=6afb6e26bb63497581bb7d62b71b718e, user_id=7fde5b91d98142f4a678af1a7e4a51b5, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:56.060109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fc7c3-01f5-4678-a020-b354678b7432 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:56.072818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 582/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:35:55 2022] PUT /identity/v3/projects/6afb6e26bb63497581bb7d62b71b718e/users/7fde5b91d98142f4a678af1a7e4a51b5/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:35:58.042520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609cd4c-a1b4-4d3e-80b7-105f3779ffe7 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:58.043060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609cd4c-a1b4-4d3e-80b7-105f3779ffe7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:58.043060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609cd4c-a1b4-4d3e-80b7-105f3779ffe7 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:58.044447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 572/1154] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:35:58.049686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:58.050076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:58.050246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:58.067112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:35:58.068254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:35:58.131454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 583/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:35:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:35:58.157177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609cd4c-a1b4-4d3e-80b7-105f3779ffe7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:58.236638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:58.255525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609cd4c-a1b4-4d3e-80b7-105f3779ffe7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:58.288132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:58.288904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:58.289187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:58.289461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:58.299926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:35:58.307502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:35:58.309225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:35:58.310251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 573/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:35:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:35:58.315329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:58.393166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:58.411267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486cdf6-dea0-41f1-bba4-2f5fd766a739 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:58.444277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:58.444931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:58.445216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:58.445494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:58.446228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:58.446535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:58.447928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:58.455911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 584/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:35:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:58.462391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:58.558492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f4187-fefd-4864-b27c-0ed8721598d0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:58.589731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:58.591087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:58.591391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:58.591663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] PATH_INFO: `/v3/users/7fde5b91d98142f4a678af1a7e4a51b5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:58.592823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] RBAC: Authorizing `identity:get_user(user_id=7fde5b91d98142f4a678af1a7e4a51b5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:58.594238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:58.595855 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 574/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:35:58 2022] GET /identity/v3/users/7fde5b91d98142f4a678af1a7e4a51b5 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:58.601608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:58.696875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e259c-0d54-4f4c-a004-4c71b5d39f47 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:58.728982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:58.729614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:58.729897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:58.730169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:58.744300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:58.798014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:58.799497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:58.893771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 585/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:35:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:35:58.899702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:58.912510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:58.996279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f49030-655c-4332-9511-1a2f561cd550 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:59.028774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b3b54-b1df-4e7c-87c8-2db9a5218912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:59.029627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b3b54-b1df-4e7c-87c8-2db9a5218912 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:59.029912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b3b54-b1df-4e7c-87c8-2db9a5218912 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:59.030197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b3b54-b1df-4e7c-87c8-2db9a5218912 None admin] PATH_INFO: `/v3/projects/6afb6e26bb63497581bb7d62b71b718e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:59.031447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b3b54-b1df-4e7c-87c8-2db9a5218912 None admin] RBAC: Authorizing `identity:get_project(project_id=6afb6e26bb63497581bb7d62b71b718e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:59.032881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b3b54-b1df-4e7c-87c8-2db9a5218912 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:59.034549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 575/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:35:58 2022] GET /identity/v3/projects/6afb6e26bb63497581bb7d62b71b718e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:35:59.040554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:35:59.083932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:35:59.135949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ef5b2-d02e-4b72-bb52-baa6b63cff0d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:35:59.168984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:35:59.169622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:35:59.169904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:35:59.170179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:35:59.170999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=6afb6e26bb63497581bb7d62b71b718e, user.id=7fde5b91d98142f4a678af1a7e4a51b5) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:35:59.171312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:35:59.172765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2b7883-1072-41d2-9e82-d1da4ce6fe15 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:35:59.178376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 586/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:35:59 2022] GET /identity/v3/role_assignments?user.id=7fde5b91d98142f4a678af1a7e4a51b5&scope.project.id=6afb6e26bb63497581bb7d62b71b718e&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:01.179277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc5e3-d77c-48f1-8515-5297cbb58bd5 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:01.179794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc5e3-d77c-48f1-8515-5297cbb58bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:01.179794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdc5e3-d77c-48f1-8515-5297cbb58bd5 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:01.181134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 576/1162] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:01.186893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:01.187284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:01.187467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:01.203609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:01.204774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:01.268338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 587/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:01.290336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdc5e3-d77c-48f1-8515-5297cbb58bd5 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:01.367511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:01.389525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdc5e3-d77c-48f1-8515-5297cbb58bd5 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:01.421559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:01.422189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:01.422475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:01.422750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:01.486362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:01.487774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:01.559794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:01.580799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 577/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:36:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:36:01.586591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:01.624967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:01.681525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074aaff3-07fa-4bcf-9656-c0609bcc835d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:01.713228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:01.714011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:01.714295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:01.714568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:01.721543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:01.722969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-e46d3bcc-4c0c-41b7-9c8b-0ad895788cd1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:36:01.737464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:36:01.738471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:36:01.739410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 588/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:36:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:36:01.744295 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:01.838436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0ad8d-a700-43a8-ad7f-b7873d7f80c8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:01.871147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:01.871824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:01.872103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:01.872372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:01.873080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:36:01.873410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:01.874757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7c6f7-f5da-4724-8de8-8267915f8d7e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:01.881622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 578/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Wed Jul 6 13:36:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:03.864551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0098bf-fe66-47cb-ba62-8d6ce40990ca None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:03.865058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0098bf-fe66-47cb-ba62-8d6ce40990ca None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:03.865164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0098bf-fe66-47cb-ba62-8d6ce40990ca None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:03.866471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 589/1167] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:03.872244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237f29f-cfe6-48f2-a731-3543a1940781 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:03.872616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237f29f-cfe6-48f2-a731-3543a1940781 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:03.872804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237f29f-cfe6-48f2-a731-3543a1940781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:03.892416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7237f29f-cfe6-48f2-a731-3543a1940781 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:03.893612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7237f29f-cfe6-48f2-a731-3543a1940781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:03.929982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:03.961226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 579/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:03.984102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0098bf-fe66-47cb-ba62-8d6ce40990ca None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:04.079397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:04.084196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0098bf-fe66-47cb-ba62-8d6ce40990ca None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:04.116385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58688ae-fa7d-411f-8a06-fffbb2ea79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:04.117024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58688ae-fa7d-411f-8a06-fffbb2ea79af None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:04.117309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58688ae-fa7d-411f-8a06-fffbb2ea79af None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:04.117585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58688ae-fa7d-411f-8a06-fffbb2ea79af None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:04.118320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58688ae-fa7d-411f-8a06-fffbb2ea79af None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:04.119723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58688ae-fa7d-411f-8a06-fffbb2ea79af None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:04.133886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 590/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Wed Jul 6 13:36:03 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:36:06.157135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d09c-3045-4206-b990-0670a9fa9305 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:06.157647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d09c-3045-4206-b990-0670a9fa9305 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:06.157647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133d09c-3045-4206-b990-0670a9fa9305 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:06.158949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 580/1170] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:06.164421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:06.164825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:06.164990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:06.184646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:06.186504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:06.252190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 591/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:06.274941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d09c-3045-4206-b990-0670a9fa9305 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:06.373941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133d09c-3045-4206-b990-0670a9fa9305 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:06.406617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afbc3a-2716-4000-a8df-b5fb3281a2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:06.407541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbc3a-2716-4000-a8df-b5fb3281a2a4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:06.407773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbc3a-2716-4000-a8df-b5fb3281a2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:06.408047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbc3a-2716-4000-a8df-b5fb3281a2a4 None admin] PATH_INFO: `/v3/domains/4b94f294dd9641898aae6f367a20b3b0` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:06.417998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afbc3a-2716-4000-a8df-b5fb3281a2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b94f294dd9641898aae6f367a20b3b0)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:06.419483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afbc3a-2716-4000-a8df-b5fb3281a2a4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:06.421092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 581/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Jul 6 13:36:06 2022] GET /identity/v3/domains/4b94f294dd9641898aae6f367a20b3b0 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:06.426847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:06.517514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:06.530513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7f5107-07a0-4095-bf08-c707ff352f38 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:06.562404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73610c-1373-429a-8f3d-b245908cc9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:06.563056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73610c-1373-429a-8f3d-b245908cc9e2 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:06.563371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73610c-1373-429a-8f3d-b245908cc9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:06.563654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73610c-1373-429a-8f3d-b245908cc9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:06.564363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73610c-1373-429a-8f3d-b245908cc9e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:06.565789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73610c-1373-429a-8f3d-b245908cc9e2 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:06.589988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 592/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:36:06 2022] POST /identity/v3/projects => generated 361 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:36:08.615157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d2b03-34b9-41c9-9f16-66163abca473 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:08.615738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d2b03-34b9-41c9-9f16-66163abca473 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:08.615738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d2b03-34b9-41c9-9f16-66163abca473 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:08.617104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 582/1174] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:08.622263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:08.622645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:08.622820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:08.639462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:08.640640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:08.704025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 593/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:08.728645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d2b03-34b9-41c9-9f16-66163abca473 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:08.758705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:08.828766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d2b03-34b9-41c9-9f16-66163abca473 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:08.861121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea929684-f9bb-462a-8205-49bda4a41bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:08.861969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929684-f9bb-462a-8205-49bda4a41bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:08.862253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929684-f9bb-462a-8205-49bda4a41bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:08.862529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea929684-f9bb-462a-8205-49bda4a41bb4 None admin] PATH_INFO: `/v3/domains/4b94f294dd9641898aae6f367a20b3b0` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:08.863716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929684-f9bb-462a-8205-49bda4a41bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4b94f294dd9641898aae6f367a20b3b0)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:08.865132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea929684-f9bb-462a-8205-49bda4a41bb4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:08.866765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 583/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Wed Jul 6 13:36:08 2022] GET /identity/v3/domains/4b94f294dd9641898aae6f367a20b3b0 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:08.872353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:08.936924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:08.968115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3f953-75a8-4e8b-8b8a-f85d8276775f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:09.000553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428b758-66bd-41aa-a4c3-c4e0b6f654ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:09.001206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b758-66bd-41aa-a4c3-c4e0b6f654ab None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:09.001489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b758-66bd-41aa-a4c3-c4e0b6f654ab None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:09.001762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428b758-66bd-41aa-a4c3-c4e0b6f654ab None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:09.002462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b758-66bd-41aa-a4c3-c4e0b6f654ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:09.003916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428b758-66bd-41aa-a4c3-c4e0b6f654ab None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:09.022978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 594/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:36:08 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:36:11.053921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f443a6-7cf0-418d-872d-32f3a0af8ab0 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:11.054461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f443a6-7cf0-418d-872d-32f3a0af8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:11.054461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f443a6-7cf0-418d-872d-32f3a0af8ab0 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:11.055856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 584/1178] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:11.061561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:11.061925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:11.062076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:11.078263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:11.079469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:11.143453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 595/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:11.166930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f443a6-7cf0-418d-872d-32f3a0af8ab0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:11.265683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:11.270021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f443a6-7cf0-418d-872d-32f3a0af8ab0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:11.302840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:11.303647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:11.303934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:11.304211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:11.314000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:36:11.321599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:36:11.322656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:36:11.323660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 585/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:36:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:36:11.328768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:11.382798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:11.425835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8190f-f93b-4260-bf3d-bf261a723dcf None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:11.461187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:11.461848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:11.462172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:11.462693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:11.463429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:36:11.463736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:11.465109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:11.473460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 596/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:36:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:11.479392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:11.575769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed966aaf-e44d-45e9-82a6-bb1a18307611 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:11.609844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:11.610697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:11.610984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:11.611262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] PATH_INFO: `/v3/users/7e40600633b14de79dfcfa9b6cc9708d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:11.624094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] RBAC: Authorizing `identity:get_user(user_id=7e40600633b14de79dfcfa9b6cc9708d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:11.625542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:11.627157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 586/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:36:11 2022] GET /identity/v3/users/7e40600633b14de79dfcfa9b6cc9708d => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:11.632660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:11.729865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b8bdf-4325-4e3a-b3d4-964f8e300067 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:11.745708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:11.761874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:11.763012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:11.763297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:11.763605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:11.827887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:11.829276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:11.922839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 597/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:36:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:36:11.928623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:11.946686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:12.025327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252a5f0-8e2d-4988-9713-0becb9d7df8e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:12.056700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91331052-3f62-4375-921c-669156c00921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:12.057542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331052-3f62-4375-921c-669156c00921 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:12.057818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331052-3f62-4375-921c-669156c00921 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:12.058115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331052-3f62-4375-921c-669156c00921 None admin] PATH_INFO: `/v3/projects/83edabf6b9934bad8a7a201af6cdca3a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:12.059789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91331052-3f62-4375-921c-669156c00921 None admin] RBAC: Authorizing `identity:get_project(project_id=83edabf6b9934bad8a7a201af6cdca3a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:12.061205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91331052-3f62-4375-921c-669156c00921 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:12.062859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 587/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:36:11 2022] GET /identity/v3/projects/83edabf6b9934bad8a7a201af6cdca3a => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:12.068989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:12.087181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:12.164255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6685fe-1bfe-4603-bb55-606d59612728 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:12.196439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:12.197183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:12.197467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:12.197743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:12.198556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=83edabf6b9934bad8a7a201af6cdca3a, user.id=7e40600633b14de79dfcfa9b6cc9708d) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:36:12.198865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:12.200873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b780bba-cea4-4e08-87d8-a992ddea496d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:12.206094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 598/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:36:12 2022] GET /identity/v3/role_assignments?user.id=7e40600633b14de79dfcfa9b6cc9708d&scope.project.id=83edabf6b9934bad8a7a201af6cdca3a&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:14.188325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0030ab-3b44-4c16-9cd1-112c6f54d608 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:14.188869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0030ab-3b44-4c16-9cd1-112c6f54d608 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:14.188869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0030ab-3b44-4c16-9cd1-112c6f54d608 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:14.190151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 588/1186] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:14.195269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:14.195692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:14.195850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:14.212920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:14.214110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:14.279285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 599/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:14.300978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0030ab-3b44-4c16-9cd1-112c6f54d608 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:14.383046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:14.399141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0030ab-3b44-4c16-9cd1-112c6f54d608 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:14.431554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:14.432336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:14.432622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:14.432895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:14.442637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:36:14.450890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:36:14.452089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:36:14.453017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 589/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:36:14.458132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:14.472903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:14.554413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69ca3-722f-4ca6-b191-6597823e7298 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:14.587017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:14.587960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:14.588247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:14.588522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:14.589265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:36:14.589571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:14.591532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:14.599459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 600/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:14.605058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:14.700855 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2a0001-d8a2-4959-a4b3-25343e56902a None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:14.732688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:14.733540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:14.733826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:14.734109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] PATH_INFO: `/v3/users/7e40600633b14de79dfcfa9b6cc9708d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:14.735276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7e40600633b14de79dfcfa9b6cc9708d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:14.736734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:14.738325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 590/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:36:14 2022] GET /identity/v3/users/7e40600633b14de79dfcfa9b6cc9708d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:14.744099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:14.818610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:14.843580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468921a-0668-4342-9dea-04348842bf1d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:14.875553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e1cd6-c6c5-4fd9-8d30-61e61381b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:14.876422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e1cd6-c6c5-4fd9-8d30-61e61381b7cb None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:14.876704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e1cd6-c6c5-4fd9-8d30-61e61381b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:14.876978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e1cd6-c6c5-4fd9-8d30-61e61381b7cb None admin] PATH_INFO: `/v3/projects/83edabf6b9934bad8a7a201af6cdca3a` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:14.878132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e1cd6-c6c5-4fd9-8d30-61e61381b7cb None admin] RBAC: Authorizing `identity:get_project(project_id=83edabf6b9934bad8a7a201af6cdca3a)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:14.879585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e1cd6-c6c5-4fd9-8d30-61e61381b7cb None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:14.881258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 601/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:36:14 2022] GET /identity/v3/projects/83edabf6b9934bad8a7a201af6cdca3a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:14.887292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:14.903355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:14.983995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bece91-7d1e-4cbf-b01f-88e7570ec7f9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:15.015583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa653ee-1849-4c9e-b8d5-45b65d661496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:15.016448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa653ee-1849-4c9e-b8d5-45b65d661496 None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:15.016734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa653ee-1849-4c9e-b8d5-45b65d661496 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:15.017014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa653ee-1849-4c9e-b8d5-45b65d661496 None admin] PATH_INFO: `/v3/projects/83edabf6b9934bad8a7a201af6cdca3a/users/7e40600633b14de79dfcfa9b6cc9708d/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:15.018938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa653ee-1849-4c9e-b8d5-45b65d661496 None admin] RBAC: Authorizing `identity:create_grant(project_id=83edabf6b9934bad8a7a201af6cdca3a, user_id=7e40600633b14de79dfcfa9b6cc9708d, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:15.020394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa653ee-1849-4c9e-b8d5-45b65d661496 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:15.032908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 591/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:36:14 2022] PUT /identity/v3/projects/83edabf6b9934bad8a7a201af6cdca3a/users/7e40600633b14de79dfcfa9b6cc9708d/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:36:17.001350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda5cc-bc5b-41d2-bcfe-0252cafda128 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.001858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda5cc-bc5b-41d2-bcfe-0252cafda128 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.001964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bda5cc-bc5b-41d2-bcfe-0252cafda128 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.003258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 602/1193] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:36:17.008440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.008804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.008999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.025171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:36:17.026347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:36:17.090736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 592/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:36:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:36:17.113775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bda5cc-bc5b-41d2-bcfe-0252cafda128 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:17.211329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bda5cc-bc5b-41d2-bcfe-0252cafda128 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:17.244120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:17.244889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.245170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.245443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.255069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:36:17.263305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:36:17.264417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:36:17.265315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 603/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:36:17.270147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:17.273147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:17.364944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db418140-4542-48ca-808d-e1c89a5a6acf None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:17.397108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:17.397755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.398036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.398307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.399037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:36:17.399359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:17.400710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:17.408949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 593/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:17.414402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:17.417207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:17.510360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13f521-bd70-4a4a-9242-c6cbc774b94f None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:17.542600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:17.543498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.543778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.544051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] PATH_INFO: `/v3/users/7e40600633b14de79dfcfa9b6cc9708d` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.545203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=7e40600633b14de79dfcfa9b6cc9708d)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:17.546624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:17.548230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 604/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed Jul 6 13:36:17 2022] GET /identity/v3/users/7e40600633b14de79dfcfa9b6cc9708d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:17.553874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:17.616738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:17.650960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe5352-b2a0-4af6-b964-5d71ee11a9f8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:17.682047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:17.682682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.682967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.683244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.747170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:17.748628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:17.807882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:17.843889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 594/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:36:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:36:17.849729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:17.916399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:17.947292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cfa19-ca45-4070-908e-c9fa4628a6a1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:17.979656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc8ebc-b6e2-4809-87b1-4f4d9320a66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:17.980513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc8ebc-b6e2-4809-87b1-4f4d9320a66b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:17.980800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc8ebc-b6e2-4809-87b1-4f4d9320a66b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:17.981078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc8ebc-b6e2-4809-87b1-4f4d9320a66b None admin] PATH_INFO: `/v3/projects/83edabf6b9934bad8a7a201af6cdca3a` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:17.982236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc8ebc-b6e2-4809-87b1-4f4d9320a66b None admin] RBAC: Authorizing `identity:get_project(project_id=83edabf6b9934bad8a7a201af6cdca3a)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:17.983704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc8ebc-b6e2-4809-87b1-4f4d9320a66b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:17.985412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 605/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Wed Jul 6 13:36:17 2022] GET /identity/v3/projects/83edabf6b9934bad8a7a201af6cdca3a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:17.991465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:36:18.086292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef703a5-0238-4038-91b9-09732e0ca5d8 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:36:18.118906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:36:18.119563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:36:18.119849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:36:18.120122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:36:18.120941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=83edabf6b9934bad8a7a201af6cdca3a, user.id=7e40600633b14de79dfcfa9b6cc9708d) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:36:18.121799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:36:18.123216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee7b85f-7550-47fd-a644-33a808efd0d6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:36:18.128780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 595/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:36:17 2022] GET /identity/v3/role_assignments?user.id=7e40600633b14de79dfcfa9b6cc9708d&scope.project.id=83edabf6b9934bad8a7a201af6cdca3a&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:36:27.975622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=31 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:36:28.126331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=85 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:13.258913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796838ea-e24f-479a-b68a-598e229cdcd3 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:13.260047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796838ea-e24f-479a-b68a-598e229cdcd3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:13.260418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796838ea-e24f-479a-b68a-598e229cdcd3 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:13.261947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 606/1201] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:37:13.269954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:13.270457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:13.270921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:13.296340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:13.298480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:13.394092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 596/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:13.418096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796838ea-e24f-479a-b68a-598e229cdcd3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:13.559745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796838ea-e24f-479a-b68a-598e229cdcd3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:13.614634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:13.615468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:13.615801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:13.616037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:13.629226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:13.630727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:13.649279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:13.650373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:13.651999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:13.651999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:13.651999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:13.651999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:13.658258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 607/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:13.658450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:13.784564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee2f27-45dd-4b39-8556-284da354b8b0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:13.829227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:13.837676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:13.838481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:13.838772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:13.839061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:13.839920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:13.840220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:13.841664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf43f12-c6bd-4f9b-8220-56f6abed7794 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:13.855182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 597/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:13.861330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:13.942097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:14.020178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d74d40e-9998-4b13-b300-1ac1521df5be None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:14.066263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818dc20-c8d0-4a32-97f6-24a4d08c9692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:14.067074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818dc20-c8d0-4a32-97f6-24a4d08c9692 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:14.067575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818dc20-c8d0-4a32-97f6-24a4d08c9692 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:14.070725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818dc20-c8d0-4a32-97f6-24a4d08c9692 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:14.070725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818dc20-c8d0-4a32-97f6-24a4d08c9692 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:14.070725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818dc20-c8d0-4a32-97f6-24a4d08c9692 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:14.096579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 608/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Wed Jul 6 13:37:13 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:37:16.361769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0839a-4a87-48bd-9564-352cede41db9 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:16.362429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0839a-4a87-48bd-9564-352cede41db9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:16.362548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0839a-4a87-48bd-9564-352cede41db9 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:16.364077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 598/1206] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:16.371624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:16.371624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:16.371624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:16.389173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:16.390797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:16.471379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 609/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:37:16.497391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0839a-4a87-48bd-9564-352cede41db9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:16.617490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0839a-4a87-48bd-9564-352cede41db9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:16.658004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:16.658853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:16.659197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:16.659518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:16.670885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:37:16.679027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:16.680292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:16.686427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 599/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:37:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:16.687195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:16.733284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:16.804076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3979e87-50fb-43e2-be2c-2f65936ab848 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:16.842367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:16.843050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:16.843358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:16.843638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:16.844384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:16.844690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:16.846059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:16.855853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 610/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:37:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:16.861486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:16.916187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:16.966968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6a18e-291c-49b4-a08c-8ae1b82d3d0c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:17.013938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:17.015413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:17.015413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:17.015413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:17.026174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:17.027627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:17.047501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:17.048498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:17.049375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:17.049375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:17.049375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:17.049375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:17.049375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 600/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:17.055227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:17.167626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:17.171014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082469ac-4e3d-4fe4-a67f-6ccb9995c27c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:17.208315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:17.209276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:17.209560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:17.209844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:17.210569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:17.210878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:17.212579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:17.224978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 611/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:17.230603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:17.343642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc6bc-0b4a-4a46-9db7-70f643327d66 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:17.345292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:17.382109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:17.382915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:17.383197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:17.383498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:17.391172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:17.392605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:37:17.407853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:17.409093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:17.410348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:17.411487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 601/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:17.414806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:17.543503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34df19-519a-4ebd-8383-6e1cfc93f3a3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:17.582311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:17.583037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:17.583402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:17.583719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:17.584670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:17.584985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:17.586537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:17.611698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 612/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 13:37:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:17.617717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:17.729009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a531de-8505-4e2e-88fd-3c4dbbd7839b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:17.766585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:17.770473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:17.770473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:17.770473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:17.804874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:17.851910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:17.854432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:17.986573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 602/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:37:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:37:17.987972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:18.010006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:18.105681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488dc3-c8bb-4a2d-86e3-57daae1efd92 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:18.146545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:18.147433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:18.147719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:18.147999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:18.162299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:18.162299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:18.185065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:18.186246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:18.192116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:18.192116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:18.192116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:18.192116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:18.192116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 613/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:18.192420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:18.274404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:18.320490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fec39-31cd-45ac-8db8-f96b4e2065a4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:18.361572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:18.362246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:18.362618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:18.362954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:18.363879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:18.364191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:18.365924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:18.385413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 603/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:18.388720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:18.479692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:18.523044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373f98e-c94c-40c5-b79c-855c1f10477e None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:18.564724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:18.565812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:18.566270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:18.566479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:18.575405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:18.577103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:37:18.594412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:18.595657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:18.596759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:18.598621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 614/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:18.606485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:18.730626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14215a18-f427-4318-ac8b-d86eb9bb1713 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:18.755592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:18.768488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:18.769159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:18.769515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:18.769905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:18.770733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:18.771047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:18.772653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0682952-8975-4367-93a6-3b96eeefbd4c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:18.791144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 604/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:18.793138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:18.905399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eed167-a4f2-4a39-ac7f-470345d02169 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:18.936348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:18.943998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:18.946367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:18.946367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:18.946367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:18.946367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=54b6895073d447cba46fe3569df20081) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:18.946856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:18.948592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e9c22-3901-410d-a9bf-76b3aebc3533 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:18.963358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 615/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:37:18 2022] GET /identity/v3/role_assignments?user.id=54b6895073d447cba46fe3569df20081&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:21.052725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7d11-b37a-4c36-9756-4fd891beb088 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:21.053303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7d11-b37a-4c36-9756-4fd891beb088 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:21.053303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7d11-b37a-4c36-9756-4fd891beb088 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:21.054619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 605/1220] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:21.060756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:21.061253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:21.061253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:21.077923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:21.079106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:21.154516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 616/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:21.181760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7d11-b37a-4c36-9756-4fd891beb088 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:21.292575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7d11-b37a-4c36-9756-4fd891beb088 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:21.328351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:21.329205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:21.329518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:21.329838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:21.342116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:37:21.351483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:21.352665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:21.354207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 606/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:37:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:21.359783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:21.466672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556dfcaa-6070-4234-aa09-1124c0ffc344 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:21.492600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:21.504325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:21.504989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:21.505279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:21.505553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:21.506301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] RBAC: Adding query filter params (name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:21.506607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:21.508013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:21.516170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 617/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:37:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:21.522160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:21.566836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:21.628984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a71b8c-727b-4d9d-8409-11e7a00a763b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:21.663243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:21.664057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:21.664341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:21.664620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:21.675576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:21.677023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:21.693962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:21.694910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:21.695995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:21.695995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:21.695995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:21.695995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:21.695995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 607/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:37:21.701116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:21.811961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155c645-a89f-4e51-8308-1b644f33bfce None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:21.853274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:21.853935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:21.854223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:21.854502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:21.855220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:21.855578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:21.856943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:21.875378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 618/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:21.879266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:21.977246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:21.985502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5ec67-3d12-4ffd-abd4-44d5e4a33d89 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:22.018808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:22.019640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:22.019922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:22.020192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:22.027971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:22.029420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:37:22.044263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:22.045204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:22.046226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 608/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:22.052050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:22.099929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:22.156729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87974b-13e8-4071-9d02-5d239d92da25 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:22.192966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:22.193736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:22.194093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:22.194375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:22.195210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:22.195552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:22.197004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:22.215167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 619/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 13:37:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:22.220886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:22.326458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f45c039-fb77-41b9-abc7-5df5c16b2e4c None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:22.364895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:22.365888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:22.366227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:22.366512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:22.377644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:22.379430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:22.397879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:22.399008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:22.400469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:22.400469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:22.400469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:22.400469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:22.400469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 609/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:22.405520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:22.527306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb19d4-6854-4a6f-bcbc-f0d4bfddd9d3 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:22.529889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:22.564597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:22.565192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:22.565496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:22.565781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:22.566506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:22.566809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:22.568214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:22.581276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 620/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:22.588271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:22.598389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:22.693744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0918ddd-1437-41ea-8b63-763fbc3b864b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:22.729148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:22.730062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:22.730353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:22.730630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:22.737760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:22.739212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:37:22.756598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:22.758149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:22.759544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 610/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:22.764659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:22.876652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda14fb-ef4d-4869-b1a8-b20981c2fffd None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:22.912035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:22.912693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:22.912983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:22.913263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:22.914040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:22.914349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:22.915879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe3d52-00d2-456e-b9f5-692e4b0104a8 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:22.928161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 621/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:22.934576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:23.005817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:23.040710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d1ef0-a85e-48f6-b81b-24a0db8b5a2b None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:23.080972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3c446-e641-4d2f-9f9b-376a697d3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:23.081742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c446-e641-4d2f-9f9b-376a697d3ad8 None admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:23.082028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c446-e641-4d2f-9f9b-376a697d3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:23.082304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3c446-e641-4d2f-9f9b-376a697d3ad8 None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/54b6895073d447cba46fe3569df20081/roles/27e44181017c47c9bdbeddab642bc1bd` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:23.101621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3c446-e641-4d2f-9f9b-376a697d3ad8 None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=54b6895073d447cba46fe3569df20081, role_id=27e44181017c47c9bdbeddab642bc1bd)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:23.103093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3c446-e641-4d2f-9f9b-376a697d3ad8 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:23.123047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 611/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:37:22 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/54b6895073d447cba46fe3569df20081/roles/27e44181017c47c9bdbeddab642bc1bd => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:37:25.133407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129598-035a-420f-a335-bb39bf4b446a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:25.133924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129598-035a-420f-a335-bb39bf4b446a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:25.133924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f129598-035a-420f-a335-bb39bf4b446a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:25.135459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 622/1233] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:25.141390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:25.141937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:25.142040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:25.159530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:25.160728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:25.229854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 612/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:25.253893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129598-035a-420f-a335-bb39bf4b446a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:25.281485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:25.371417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f129598-035a-420f-a335-bb39bf4b446a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:25.406918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:25.407683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:25.407975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:25.408248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:25.418822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:37:25.426583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:25.427707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:25.428818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 623/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Wed Jul 6 13:37:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:25.435088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:25.492288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:25.554818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb0634-05fd-486c-b4a5-41ae825ef2f3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:25.592658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:25.593391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:25.593762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:25.594041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:25.594873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:25.595177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:25.596602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:25.605330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 613/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Wed Jul 6 13:37:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:25.611198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:25.701860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:25.719901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e96e93-c06f-45e2-b28f-be930672c211 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:25.755677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:25.756504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:25.756854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:25.757109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:25.768654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:25.770249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:25.791054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:25.792457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:25.793676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:25.793676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:25.793676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:25.793676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:25.793676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 624/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:25.798204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:25.907881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8c344-216c-4ed6-ac2e-5fde440affd7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:25.917610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:25.943449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:25.944110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:25.944393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:25.944664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:25.945377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:25.945681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:25.947680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:25.959289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 614/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:37:25.965250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:26.070024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d63ca-22be-41d9-b517-99d9f86ae387 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:26.105266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:26.106061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:26.106347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:26.106623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:26.111734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:26.117121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:26.119117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:37:26.136391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:26.138010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:26.138969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 625/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:26.143734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:26.260099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e5399-9b5b-4189-b5b5-d2cbfaf28150 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:26.294922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:26.295620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:26.295902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:26.296175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:26.297006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:26.297314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:26.298747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:26.318491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 615/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 13:37:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:26.324325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:26.435065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671be039-d2e9-47f8-b76e-fe423f334645 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:26.471295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:26.471971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:26.472337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:26.472609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:26.558768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:26.565809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:26.567329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:26.680869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 626/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:37:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:37:26.686933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:26.719029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:26.799986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd226c21-b787-41d7-ba20-fdf948d7d781 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:26.834051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:26.834808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:26.835171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:26.835498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:26.846747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:26.848228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:26.867077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:26.868769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:26.870044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:26.870044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:26.870044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:26.870044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:26.873491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 616/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:26.874573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:26.980009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:26.989548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1769d6f7-4cbb-405e-aeee-3f75156ca1ef None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:27.028006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:27.028798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:27.029212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:27.029520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:27.030354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:27.030790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:27.032209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:27.045827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 627/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:27.051636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:27.144674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:27.172250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41572e3-6db3-4978-aa31-3dfdcade8fe4 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:27.208941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:27.209938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:27.210225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:27.210506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:27.219380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:27.221052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:37:27.235726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:27.236798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:27.237834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 617/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:37:27.243552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:27.357749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17f15d-ce7a-4c85-8f9f-9e577c677222 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:27.395389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:27.395985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:27.396358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:27.396649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:27.397543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:27.397865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:27.399530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f445f-d75a-4f8d-81c1-358b73caa566 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:27.413304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 628/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:27.420084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:27.551519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1597521-b250-404a-b135-c6a4010786f6 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:27.585835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:27.586734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:27.587018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:27.587287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:27.588136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] RBAC: Adding query filter params (role.id=27e44181017c47c9bdbeddab642bc1bd, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=54b6895073d447cba46fe3569df20081) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:27.588443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:27.589873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b190d9-8dfa-4a3c-a3bb-71702b7aebc7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:27.595497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 618/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:37:27 2022] GET /identity/v3/role_assignments?user.id=54b6895073d447cba46fe3569df20081&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=27e44181017c47c9bdbeddab642bc1bd => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:29.742121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19957e4-a6b8-4124-b9b5-4d8d87f79de0 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:29.742671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19957e4-a6b8-4124-b9b5-4d8d87f79de0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:29.742671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19957e4-a6b8-4124-b9b5-4d8d87f79de0 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:29.744123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 629/1247] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:29.749347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:29.749773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:29.749917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:29.755366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:29.768510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:29.769806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:29.857600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 619/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:29.881083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19957e4-a6b8-4124-b9b5-4d8d87f79de0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:29.906145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:30.018943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19957e4-a6b8-4124-b9b5-4d8d87f79de0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:30.065888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:30.066825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:30.067166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:30.067535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:30.080985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:37:30.090197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:30.091245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:30.092131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 630/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:37:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:30.098153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:30.209461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fede15a-e17a-4f29-a495-103b4b1f5957 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:30.241725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:30.247275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:30.248060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:30.248373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:30.248645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:30.249528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:30.249845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:30.251366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:30.264528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 620/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:30.270290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:30.353768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:30.382281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a7d38-ecfc-4e76-bab5-eaf5a2b37695 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:30.419832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:30.420643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:30.420967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:30.421281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:30.434055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:30.435558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:30.455086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:30.456151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:30.457062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:30.457062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:30.457062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:30.457062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:30.457062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 631/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:30.462763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:30.577826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31010a-b1a0-4333-8673-b198d4ffc0e1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:30.614351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:30.615131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:30.615550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:30.615923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:30.616998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:30.617447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:30.619669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:30.637241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 621/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:30.643603 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:30.765900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5f0c6-2fdd-414b-9b55-a074d0be70b7 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:30.808045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:30.817461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:30.818248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:30.818532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:30.818808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:30.828035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:30.829511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:37:30.845903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:30.847092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:30.848090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 632/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:30.853876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:30.922995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:30.974644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae477a-1cb2-409b-a17c-4e8d7f588ed9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:31.012371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:31.013076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:31.013352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:31.013676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:31.014426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:31.014733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:31.016197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:31.034224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 622/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 13:37:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:31.040722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:31.148641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf81d0-21b9-4282-918f-63dc68dcc943 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:31.184952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:31.185546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:31.185826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:31.186104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:31.249412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:31.264560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:31.266120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:31.375037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 633/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:37:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 13:37:31.381080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:31.496994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399fe7a2-88d9-4a86-9385-27ea816c6ef1 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:31.512733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:31.543859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:31.545191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:31.545621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:31.546080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:31.561104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:31.563852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:31.583639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:31.584864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:31.585994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:31.585994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:31.585994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:31.585994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:31.585994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 623/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:31.591958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:31.697955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:31.713683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac8fd-0baa-420a-88c7-50522af66271 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:31.751352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:31.751967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:31.752257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:31.752545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:31.753266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:31.753573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:31.754955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:31.768003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 634/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:37:31.773808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:31.877431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bd15c-5702-4634-80a1-20bbefcfa03f None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:31.913020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:31.913837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:31.914122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:31.914398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:31.922154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:31.923730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:37:31.938516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:31.939672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:31.940811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:31.944971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 624/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:37:31.945897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:32.051408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639eecf-511e-43b6-9b66-9e37444f4376 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:32.085775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:32.086785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:32.087113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:32.087426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:32.088304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:32.088601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:32.090088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f552f-dbcd-46bf-ad02-d5abdc04f6cf None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:32.102207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 635/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:32.108659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:32.136869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:32.219187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883774d7-f831-4d7e-9db3-1e14b2d3b494 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:32.254628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:32.255336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:32.255629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:32.255957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:32.256844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=54b6895073d447cba46fe3569df20081) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:32.257225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:32.259308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d174dc4-ed5f-46e4-910a-c3e11de686fc None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:32.265230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 625/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:37:32 2022] GET /identity/v3/role_assignments?user.id=54b6895073d447cba46fe3569df20081&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=729660ef64b242119ec8e65a05f1e171 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:34.281284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b950-3ea5-4968-afa7-6458b1537b4b None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:34.281781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b950-3ea5-4968-afa7-6458b1537b4b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:34.281781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c8b950-3ea5-4968-afa7-6458b1537b4b None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:34.283100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 636/1261] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:34.288403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:34.288854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:34.288948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:34.305157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:34.306856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:34.370153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 626/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:34.392803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8b950-3ea5-4968-afa7-6458b1537b4b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:34.403309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:34.491380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c8b950-3ea5-4968-afa7-6458b1537b4b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:34.525980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:34.526760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:34.527044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:34.527348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:34.537149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:37:34.545142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:34.546222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:34.547234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 637/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:37:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:34.552436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:34.570514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:34.651203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d49398-3a75-491b-bcc5-5f2e1c5d373f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:34.685000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:34.685660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:34.685946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:34.686225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:34.686970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:34.687280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:34.688671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:34.696613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 627/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:37:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:34.702213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:34.766777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:34.799384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e8d28-575e-4879-ba45-14c853360505 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:34.831880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:34.832661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:34.832943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:34.833221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:34.843785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:34.845223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:34.862303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:34.863347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:34.864629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:34.864629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:34.864629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:34.864629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:34.864629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 638/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:34.869776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:34.948057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:34.967253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c01503-5700-4498-8176-cda636bb0605 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:34.999611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.000260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.000545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.000823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.001534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:35.001840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.003217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.014539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 628/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:35.020116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:35.116711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474f988-3bca-4430-96dd-789a3bc1317c None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:35.135338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:35.149579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.150363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.150645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.150919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.158142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.159604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:37:35.174105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:35.175171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:35.176176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 639/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:35.181319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:35.276736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdab6bb4-e1e6-4159-b533-bcfc16339f46 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:35.308566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.309220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.309505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.309782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.310606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:35.310913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.312369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.320721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:35.330113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 629/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 13:37:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:35.335688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:35.432271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166fcdc-9dd5-43bd-8f4b-0cc01849be61 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:35.465336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.466101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.466387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.466663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.477292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.478723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:35.497356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:35.498309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:35.499492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:35.499492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:35.499492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:35.499492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:35.499492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 640/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:35.504801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:35.604912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0fe50-b7dd-49f2-aaa2-86b9c29552a7 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:35.637760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.638415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.638703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.638983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.639729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:35.640041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.641400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.652163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 630/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:35.657646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:35.688850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:35.756239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fdc50-e530-4f0d-9f07-3c17f48ecf6d None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:35.788705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.789483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.789793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.790068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.796748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.798218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:37:35.813250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:35.814263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:35.815412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 641/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:37:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:35.820128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:35.876524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:35.916623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428956b3-4637-4cd7-81e2-518e60546f9e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:35.948734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:35.949318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:35.949599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:35.949868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:35.950636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:35.950940 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:35.952400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca636d2-7450-4776-82a5-2cabf619540a None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:35.964037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 631/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:37:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:35.969935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:36.058509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:36.067108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e95fd7-705e-45ed-9d8e-4295485add86 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:36.099182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45250eeb-08ab-466d-8d58-a6d50407ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:36.100070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250eeb-08ab-466d-8d58-a6d50407ebda None admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:36.100348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250eeb-08ab-466d-8d58-a6d50407ebda None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:36.100619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45250eeb-08ab-466d-8d58-a6d50407ebda None admin] PATH_INFO: `/v3/projects/134673dce74a484984ee7674236e10f9/users/54b6895073d447cba46fe3569df20081/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:36.103027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45250eeb-08ab-466d-8d58-a6d50407ebda None admin] RBAC: Authorizing `identity:create_grant(project_id=134673dce74a484984ee7674236e10f9, user_id=54b6895073d447cba46fe3569df20081, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:36.104479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45250eeb-08ab-466d-8d58-a6d50407ebda None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:36.116275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 642/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Wed Jul 6 13:37:35 2022] PUT /identity/v3/projects/134673dce74a484984ee7674236e10f9/users/54b6895073d447cba46fe3569df20081/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:37:38.108457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de12a4f-9e09-400e-ae49-ef0226a63b06 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.108955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de12a4f-9e09-400e-ae49-ef0226a63b06 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.108955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de12a4f-9e09-400e-ae49-ef0226a63b06 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.110278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 632/1274] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:38.115257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.115714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.115829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.132077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:38.133239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:38.197668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 643/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 13:37:38.221498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de12a4f-9e09-400e-ae49-ef0226a63b06 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:38.319585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de12a4f-9e09-400e-ae49-ef0226a63b06 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:38.337389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:38.353929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:38.354701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.354984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.355260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.365144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 13:37:38.372767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:38.373872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:38.374988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 633/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Wed Jul 6 13:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:38.379939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:38.459377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:38.480100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200022-7403-4a71-894d-2b57951163b7 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:38.516587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:38.517324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.517619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.517936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.518832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:38.519246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:38.521027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:38.532125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 644/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Wed Jul 6 13:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:38.539097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:38.635657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184aee2-bb99-4a2c-a5a8-2e1ac2f7acab None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:38.671389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:38.672174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.672457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.672734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.683310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:38.684783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:38.701832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:38.702830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:38.703963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:38.703963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:38.703963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:38.703963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:38.703963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 634/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 13:37:38.710126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:38.806783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574289f2-58b9-447e-a1ab-3ab810cabf59 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:38.839267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:38.839962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.840249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.840527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.841239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:38.841546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:38.842908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:38.854287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 645/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:38.859832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:38.890258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:38.956276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e74c7a-f0e0-4e85-a6b4-790d1e3865d9 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:38.987864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:38.988636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:38.988915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:38.989189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:38.996834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:38.998245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 13:37:39.012819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:39.013936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:39.015111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 635/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:39.019705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:39.023404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:39.115471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f23bda-4258-473f-87db-4d522f5abd85 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:39.147935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:39.148525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:39.148807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:39.149083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:39.149906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:39.150211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:39.151652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:39.168621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 646/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Wed Jul 6 13:37:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:39.174202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:39.260167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:39.269669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de27ae8-2fd3-4c84-860b-74b91d9ceb6d None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:39.301358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:39.301980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:39.302262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:39.302533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:39.366419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:39.368468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:39.451607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:39.462270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 636/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Wed Jul 6 13:37:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 13:37:39.467903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:39.532093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:39.569079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8756875f-125c-4a9a-91b8-6c13605765a1 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:39.601411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:39.602806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:39.603086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:39.603386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:39.613022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:39.614454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 13:37:39.631243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:39.632301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:39.633495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 13:37:39.633495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 13:37:39.633495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 13:37:39.633495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:39.633495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 647/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:39.637934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:39.732326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b2ee0-e1be-4cda-bbd5-ab23e6efb684 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:39.764660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:39.765294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:39.765574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:39.765843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:39.766548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:39.766848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:39.768219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:39.779392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 637/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Wed Jul 6 13:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:39.784641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:39.881419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bcc07-a12a-4313-8692-a22ee1b0a827 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:39.895461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:39.916919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:39.917706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:39.917993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:39.918272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:39.925555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:39.927400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 13:37:39.941158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:39.942288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: ERROR keystone.server.flask.application Jul 06 13:37:39.943551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 648/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Wed Jul 6 13:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:39.948704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:39.996489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:40.046561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951321c-531b-4912-86c6-15aa961fb4e0 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:40.078694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:40.079366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:40.079650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:40.079921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:40.080702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:40.081008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:40.082438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9a58-0666-4238-b568-383670fc889b None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:40.095001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 638/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Wed Jul 6 13:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:40.100956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:40.198043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f9769-6f9d-49ea-b589-dcf72b5f6599 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:40.229939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:40.230576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:40.230859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:40.231136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:40.231984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] RBAC: Adding query filter params (role.id=729660ef64b242119ec8e65a05f1e171, scope.project.id=134673dce74a484984ee7674236e10f9, user.id=54b6895073d447cba46fe3569df20081) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:40.232297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:40.233756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba859-038a-43c7-b09e-8c7dc90f2fd6 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:40.239492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 649/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Wed Jul 6 13:37:40 2022] GET /identity/v3/role_assignments?user.id=54b6895073d447cba46fe3569df20081&scope.project.id=134673dce74a484984ee7674236e10f9&role.id=729660ef64b242119ec8e65a05f1e171 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:42.279888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06a384-15d8-4c72-8c5c-906f9c6a0c5d None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:42.280409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06a384-15d8-4c72-8c5c-906f9c6a0c5d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:42.280409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06a384-15d8-4c72-8c5c-906f9c6a0c5d None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:42.281703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 639/1288] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:42.286935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:42.287374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:42.287524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:42.304250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:42.306053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:42.335680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:42.372581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 650/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:42.394693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06a384-15d8-4c72-8c5c-906f9c6a0c5d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:42.493457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06a384-15d8-4c72-8c5c-906f9c6a0c5d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:42.504131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:42.532694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:42.533388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:42.533704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:42.533977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:42.534626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:42.536042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:42.548870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:42.550047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:42.550899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 640/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:37:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:42.556223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:42.650800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a98c24-5099-4970-b590-b5e495c3b425 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:42.684872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:42.685529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:42.685810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:42.686087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:42.686785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:42.687089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:42.688483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a377-6669-48f2-8254-2c6b5ab7245f None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:42.693163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 651/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 13:37:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:42.698800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:42.794011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925b900-f523-4458-8acd-c23578fb2d47 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:42.826434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:42.827093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:42.827410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:42.827689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] PATH_INFO: `/v3/services` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:42.828395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:42.828702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:42.830059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f377052-6a37-4e6e-8d2f-00ea2f0f0fe5 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:42.834431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 641/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 13:37:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:44.800542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289293fe-be86-4243-8110-f0d3c26ba4aa None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:44.801095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289293fe-be86-4243-8110-f0d3c26ba4aa None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:44.801095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289293fe-be86-4243-8110-f0d3c26ba4aa None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:44.802455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 652/1293] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:44.807745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973f463-a730-45d0-9c14-74178a167d88 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:44.808121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973f463-a730-45d0-9c14-74178a167d88 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:44.808312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973f463-a730-45d0-9c14-74178a167d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:44.824574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6973f463-a730-45d0-9c14-74178a167d88 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:44.825776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6973f463-a730-45d0-9c14-74178a167d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:44.854780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:44.890698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 642/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:44.913623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289293fe-be86-4243-8110-f0d3c26ba4aa None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:44.944012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:45.012228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289293fe-be86-4243-8110-f0d3c26ba4aa None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:45.049056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5ca51-31e7-438e-9b49-2df712910619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:45.049711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ca51-31e7-438e-9b49-2df712910619 None admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:45.049997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ca51-31e7-438e-9b49-2df712910619 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:45.050273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5ca51-31e7-438e-9b49-2df712910619 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:45.051042 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ca51-31e7-438e-9b49-2df712910619 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:45.052386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5ca51-31e7-438e-9b49-2df712910619 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:45.064970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 653/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Wed Jul 6 13:37:44 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:37:47.057627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de6164-e68a-4d71-ab12-18a049a5094f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:47.058155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de6164-e68a-4d71-ab12-18a049a5094f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:47.058155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de6164-e68a-4d71-ab12-18a049a5094f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:47.059479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 643/1296] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:47.064579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:47.064994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:47.065138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:47.082004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:47.083176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:47.153795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 654/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:47.175851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de6164-e68a-4d71-ab12-18a049a5094f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:47.272141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de6164-e68a-4d71-ab12-18a049a5094f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:47.303857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:47.304631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:47.305461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:47.305733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] PATH_INFO: `/v3/services/placement` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:47.306374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:47.307816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:47.319111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:47.320369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:47.321556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 644/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:37:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:47.325980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:47.343928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:47.421838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d2e2-c6cc-4a08-a3aa-2b6d960c03b9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:47.454314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:47.454966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:47.455253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:47.455560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:47.456254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:47.456558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:47.457923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:47.463107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 655/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 13:37:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:47.468886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:47.504779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:47.576498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f76eae-67b1-4fed-96eb-7eb2ed8f998e None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:47.608626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:47.609266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:47.609547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:47.609820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:47.610594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] RBAC: Adding query filter params (interface=public, service_id=af150af5b3c24b7080e9f4a001182cfc, region_id=RegionOne) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:47.610901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:47.612275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb217b9d-e8c1-4853-8638-23cd5f3f5e45 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:47.617095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 645/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Wed Jul 6 13:37:47 2022] GET /identity/v3/endpoints?service_id=af150af5b3c24b7080e9f4a001182cfc&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:37:47.623299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:47.700729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:47.719091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46c4b1-ffbe-4c02-a240-20a053303703 None admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:47.751978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ea7e5-099d-4c67-9ba7-4b93dc79a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:47.752626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea7e5-099d-4c67-9ba7-4b93dc79a72b None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:47.752905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea7e5-099d-4c67-9ba7-4b93dc79a72b None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:47.753179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ea7e5-099d-4c67-9ba7-4b93dc79a72b None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:47.753846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ea7e5-099d-4c67-9ba7-4b93dc79a72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:47.755198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ea7e5-099d-4c67-9ba7-4b93dc79a72b None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:47.761777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 656/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Wed Jul 6 13:37:47 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:37:49.748680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee83555-175a-4bc6-9286-ca2c7d51d5a3 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:49.749240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee83555-175a-4bc6-9286-ca2c7d51d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:49.749240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee83555-175a-4bc6-9286-ca2c7d51d5a3 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:49.750564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 646/1302] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:37:49.755762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:49.756134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:49.756332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:49.772641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:37:49.773823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:37:49.838682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 657/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:37:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 13:37:49.861178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee83555-175a-4bc6-9286-ca2c7d51d5a3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:49.952608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:49.959832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee83555-175a-4bc6-9286-ca2c7d51d5a3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:49.992891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:49.993669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:49.993953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:49.994229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:49.994878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:49.996261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 13:37:50.007955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 13:37:50.009092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application with Lock( Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self._enter() Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application return self.creator() Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application created_value = creator( Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: ERROR keystone.server.flask.application Jul 06 13:37:50.010065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 647/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Wed Jul 6 13:37:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 13:37:50.015067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:50.088696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:37:50.111364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc36e7-d200-4fb0-9c50-36f84b21a832 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:50.143932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:50.144591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:50.144877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:50.145155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] PATH_INFO: `/v3/services` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:50.145859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:37:50.146168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:50.147561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7877953a-09fa-4b5c-8620-322376b87990 None admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:50.153154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 658/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Wed Jul 6 13:37:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:37:50.158939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:37:50.253805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a12cfc-f21c-4e3a-a2db-919e8b4eedd3 None admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:37:50.286088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755b490-8221-470c-a7a8-47bca09bd102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:37:50.286660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b490-8221-470c-a7a8-47bca09bd102 None admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:37:50.286941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b490-8221-470c-a7a8-47bca09bd102 None admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:37:50.287216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755b490-8221-470c-a7a8-47bca09bd102 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:37:50.287970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b490-8221-470c-a7a8-47bca09bd102 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:37:50.289347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755b490-8221-470c-a7a8-47bca09bd102 None admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:37:50.306432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 648/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Wed Jul 6 13:37:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:38:00.159801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=30 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:00.302249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:52.633133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce610-4407-4b42-a1b2-7655a6a51adb None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:52.634228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce610-4407-4b42-a1b2-7655a6a51adb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:52.634735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ce610-4407-4b42-a1b2-7655a6a51adb None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:52.640387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 659/1307] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:38:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:38:52.641829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7271-4337-4fb6-b7d2-b42bb21c7399 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:52.642254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7271-4337-4fb6-b7d2-b42bb21c7399 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:52.642468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e7271-4337-4fb6-b7d2-b42bb21c7399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:52.734296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-fb8e7271-4337-4fb6-b7d2-b42bb21c7399 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:38:52.735781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-fb8e7271-4337-4fb6-b7d2-b42bb21c7399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:52.875980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 649/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:38:52.919265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bcdae-3334-45d2-9aef-c1fc75cbad6b None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:52.919725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bcdae-3334-45d2-9aef-c1fc75cbad6b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:52.920032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bcdae-3334-45d2-9aef-c1fc75cbad6b None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:52.922418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 660/1309] 10.222.0.25 () {54 vars in 964 bytes} [Wed Jul 6 13:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:38:52.934009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca71fc-d39d-47e7-8a80-70d9836a339a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:52.935167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca71fc-d39d-47e7-8a80-70d9836a339a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:52.935655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca71fc-d39d-47e7-8a80-70d9836a339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:53.040923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1dca71fc-d39d-47e7-8a80-70d9836a339a None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:38:53.042448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1dca71fc-d39d-47e7-8a80-70d9836a339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:53.088849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:53.156017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 650/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Jul 6 13:38:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:38:53.165864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bcdae-3334-45d2-9aef-c1fc75cbad6b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:38:53.167615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3d9bcdae-3334-45d2-9aef-c1fc75cbad6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:53.275893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bcdae-3334-45d2-9aef-c1fc75cbad6b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:38:53.347527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:38:53.348179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:53.348490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:53.348767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:53.350388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:53.403786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:53.461237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:38:53.462674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357eae19-c3e2-41b5-97ce-d81ec0ecb1b0 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:38:53.482029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 661/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:38:55.850330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681ca5-277c-4bd4-b193-095e5702a762 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:55.850861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681ca5-277c-4bd4-b193-095e5702a762 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:55.850861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681ca5-277c-4bd4-b193-095e5702a762 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:55.852435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 651/1312] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:38:55.857564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3244-b2fa-46fd-8684-39e87b3e6488 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:55.857998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3244-b2fa-46fd-8684-39e87b3e6488 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:55.858189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a3244-b2fa-46fd-8684-39e87b3e6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:55.936868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2b4a3244-b2fa-46fd-8684-39e87b3e6488 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:38:55.938006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2b4a3244-b2fa-46fd-8684-39e87b3e6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:56.041133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 662/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:38:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:38:56.077023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89681ca5-277c-4bd4-b193-095e5702a762 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:38:56.078796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-89681ca5-277c-4bd4-b193-095e5702a762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:56.200237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89681ca5-277c-4bd4-b193-095e5702a762 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:38:56.277968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:56.281062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:38:56.282052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:56.282707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:56.283206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:56.285490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:56.396717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:38:56.398157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4ba820-bcd5-4405-a2fe-4a3e488eb4f4 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:38:56.416278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 652/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:38:58.710299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1831c4b-fabe-4c48-b320-a174d0587adb None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:58.710823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1831c4b-fabe-4c48-b320-a174d0587adb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:58.710914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1831c4b-fabe-4c48-b320-a174d0587adb None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:58.712265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 663/1315] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:38:58.717247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297847-16d4-4e83-a660-16251f04ae89 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:58.717624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297847-16d4-4e83-a660-16251f04ae89 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:58.717802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13297847-16d4-4e83-a660-16251f04ae89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:58.779601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-13297847-16d4-4e83-a660-16251f04ae89 None None] MFA Rules not processed for user `3243d044257f4a73b3712a5d22235385`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:38:58.780799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-13297847-16d4-4e83-a660-16251f04ae89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:58.830126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:58.873344 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 653/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:38:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:38:58.912015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1831c4b-fabe-4c48-b320-a174d0587adb None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:38:58.913555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e1831c4b-fabe-4c48-b320-a174d0587adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:58.923234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:59.018767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1831c4b-fabe-4c48-b320-a174d0587adb None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:38:59.089621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:38:59.090190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:38:59.090469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:38:59.090738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:38:59.092396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:38:59.152193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:38:59.198311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:38:59.199783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1d34e-797c-4a11-92d0-49fcc1b6119a service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:38:59.218029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 664/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:38:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:01.748407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0394f-38c0-4c0f-bb51-cfc19de51e51 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:01.748979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0394f-38c0-4c0f-bb51-cfc19de51e51 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:01.748979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0394f-38c0-4c0f-bb51-cfc19de51e51 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:01.750310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 654/1318] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:01.756105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628f55c-cb2e-4f3a-a8cd-2f8bbc771ed0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:01.756543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628f55c-cb2e-4f3a-a8cd-2f8bbc771ed0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:01.756664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628f55c-cb2e-4f3a-a8cd-2f8bbc771ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:01.820648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-3628f55c-cb2e-4f3a-a8cd-2f8bbc771ed0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:01.821856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3628f55c-cb2e-4f3a-a8cd-2f8bbc771ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:01.916962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 665/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:01.955671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0394f-38c0-4c0f-bb51-cfc19de51e51 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:01.957197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-37e0394f-38c0-4c0f-bb51-cfc19de51e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:02.056109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0394f-38c0-4c0f-bb51-cfc19de51e51 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:02.125508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:02.126135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:02.126414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:02.126686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:02.128319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:02.135993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:02.233520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:02.234985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e20785-d873-4aa6-9532-ab0373531ab6 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:02.254332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 655/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:39:04.942250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3cf28-e787-496b-b471-2a73eeec3d50 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:04.942780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3cf28-e787-496b-b471-2a73eeec3d50 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:04.942780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3cf28-e787-496b-b471-2a73eeec3d50 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:04.944190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 666/1321] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:04.949671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b01f8-ad0a-4213-8f74-a4a3c6805a2e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:04.950108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b01f8-ad0a-4213-8f74-a4a3c6805a2e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:04.950326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b01f8-ad0a-4213-8f74-a4a3c6805a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:05.015859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d91b01f8-ad0a-4213-8f74-a4a3c6805a2e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:05.017059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d91b01f8-ad0a-4213-8f74-a4a3c6805a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:05.079847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:05.123702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 656/1322] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:05.172888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2ccd-ff79-4a30-a493-537ace7a4b85 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:05.173182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2ccd-ff79-4a30-a493-537ace7a4b85 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:05.173465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa2ccd-ff79-4a30-a493-537ace7a4b85 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:05.174884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 667/1323] 10.222.0.25 () {54 vars in 964 bytes} [Wed Jul 6 13:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:05.181794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41820e-30db-43bb-afdc-b52fac9a64ff None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:05.182093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41820e-30db-43bb-afdc-b52fac9a64ff None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:05.182398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41820e-30db-43bb-afdc-b52fac9a64ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:05.260415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-da41820e-30db-43bb-afdc-b52fac9a64ff None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:05.261611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-da41820e-30db-43bb-afdc-b52fac9a64ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:05.335744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 657/1324] 10.222.0.25 () {58 vars in 1061 bytes} [Wed Jul 6 13:39:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:05.344987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2ccd-ff79-4a30-a493-537ace7a4b85 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:05.346504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b5aa2ccd-ff79-4a30-a493-537ace7a4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:05.366212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:05.450041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa2ccd-ff79-4a30-a493-537ace7a4b85 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:05.523620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:05.524191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:05.524480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:05.524760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:05.526405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:05.596257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:05.634310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:05.635785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd0589c-cfe9-49bd-b3ef-9b359bf62c13 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:05.654575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 668/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:07.950514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3917-0911-4003-b1db-3a8689a76831 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:07.951040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3917-0911-4003-b1db-3a8689a76831 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:07.951134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd3917-0911-4003-b1db-3a8689a76831 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:07.952468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 658/1326] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:07.957838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33f3d-0e25-4b01-83a4-b73e6ec95e38 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:07.958749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33f3d-0e25-4b01-83a4-b73e6ec95e38 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:07.958928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde33f3d-0e25-4b01-83a4-b73e6ec95e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:08.025394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-dde33f3d-0e25-4b01-83a4-b73e6ec95e38 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:08.026609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-dde33f3d-0e25-4b01-83a4-b73e6ec95e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:08.129875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 669/1327] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:08.165553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3917-0911-4003-b1db-3a8689a76831 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:08.167103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3afd3917-0911-4003-b1db-3a8689a76831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:08.226880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:08.273825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd3917-0911-4003-b1db-3a8689a76831 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:08.352925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:08.353576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:08.353863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:08.354138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:08.355814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:08.462030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:08.464471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:08.466232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89da5-589a-42e1-a9b9-e17066fa4385 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:08.485937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 659/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:10.561351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146a20-3444-4a59-9fe0-2a62bc8b6d87 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:10.561759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146a20-3444-4a59-9fe0-2a62bc8b6d87 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:10.561931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13146a20-3444-4a59-9fe0-2a62bc8b6d87 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:10.563261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 670/1329] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:10.568644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e671-0702-4d50-88e6-235afacd5194 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:10.569050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e671-0702-4d50-88e6-235afacd5194 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:10.569208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d57e671-0702-4d50-88e6-235afacd5194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:10.631744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7d57e671-0702-4d50-88e6-235afacd5194 None None] MFA Rules not processed for user `3243d044257f4a73b3712a5d22235385`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:10.632960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7d57e671-0702-4d50-88e6-235afacd5194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:10.745389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 660/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:39:10.782868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146a20-3444-4a59-9fe0-2a62bc8b6d87 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:10.784826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-13146a20-3444-4a59-9fe0-2a62bc8b6d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:10.818359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:10.889865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13146a20-3444-4a59-9fe0-2a62bc8b6d87 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:10.964410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:10.964978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:10.965261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:10.965534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:10.967156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:11.044821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:11.077442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:11.078930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd5491-002f-48ca-8285-18c401c3e44a service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:11.099542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 671/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:39:13.543180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a254-175a-4ade-a2b7-bdd761ca5f1a None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:13.543776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a254-175a-4ade-a2b7-bdd761ca5f1a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:13.543776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9a254-175a-4ade-a2b7-bdd761ca5f1a None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:13.545160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 661/1332] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:13.550344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f9e8-e3bf-41ab-a46b-b7cf80ee4264 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:13.550718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f9e8-e3bf-41ab-a46b-b7cf80ee4264 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:13.550911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a02f9e8-e3bf-41ab-a46b-b7cf80ee4264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:13.617641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-3a02f9e8-e3bf-41ab-a46b-b7cf80ee4264 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:13.618832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3a02f9e8-e3bf-41ab-a46b-b7cf80ee4264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:13.712621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 672/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:13.747367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9a254-175a-4ade-a2b7-bdd761ca5f1a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:13.748871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-afd9a254-175a-4ade-a2b7-bdd761ca5f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:13.816489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:13.850829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9a254-175a-4ade-a2b7-bdd761ca5f1a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:13.922183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:13.922826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:13.923106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:13.923404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:13.925036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:14.030262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:14.031706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191e369-63c7-42c6-8881-f7e007078d13 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:14.041309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:14.049477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 662/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:16.100274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99e63-db96-4a9f-b56c-745bb9963857 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:16.100793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99e63-db96-4a9f-b56c-745bb9963857 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:16.100793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99e63-db96-4a9f-b56c-745bb9963857 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:16.102116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 673/1335] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:16.107250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe678f-5b8d-4232-96d6-554bdee85602 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:16.107699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe678f-5b8d-4232-96d6-554bdee85602 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:16.107842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe678f-5b8d-4232-96d6-554bdee85602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:16.170910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f7fe678f-5b8d-4232-96d6-554bdee85602 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:16.172152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f7fe678f-5b8d-4232-96d6-554bdee85602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:16.264816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 663/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:16.304378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99e63-db96-4a9f-b56c-745bb9963857 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:16.305891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b4a99e63-db96-4a9f-b56c-745bb9963857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:16.345579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:16.407814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a99e63-db96-4a9f-b56c-745bb9963857 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:16.478770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:16.479441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:16.479727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:16.480002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:16.481625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:16.563743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:16.595026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:16.597250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f7653-f957-4a1e-9540-74c48a40e87e service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:16.615183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 674/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:39:18.913558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94445-0ebc-4e03-ab32-87aeded8cae8 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:18.914120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94445-0ebc-4e03-ab32-87aeded8cae8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:18.914120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc94445-0ebc-4e03-ab32-87aeded8cae8 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:18.915446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 664/1338] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:18.920715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc314c4-445c-4139-9cca-8dfd3db5a056 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:18.921137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc314c4-445c-4139-9cca-8dfd3db5a056 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:18.921282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc314c4-445c-4139-9cca-8dfd3db5a056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:18.985032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1cc314c4-445c-4139-9cca-8dfd3db5a056 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:18.986216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1cc314c4-445c-4139-9cca-8dfd3db5a056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:19.078451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 675/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:19.115094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94445-0ebc-4e03-ab32-87aeded8cae8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:19.116642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7dc94445-0ebc-4e03-ab32-87aeded8cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:19.190753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:19.218772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc94445-0ebc-4e03-ab32-87aeded8cae8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:19.289645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:19.290294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:19.290578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:19.290853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:19.292533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:19.397020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:19.398441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06759-4660-4408-966b-859dc1f58f2c service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:19.417608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 665/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:23.493447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5cedf-3115-4a57-b20e-a63052d52e70 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:23.494004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5cedf-3115-4a57-b20e-a63052d52e70 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:23.494004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5cedf-3115-4a57-b20e-a63052d52e70 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:23.495843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 676/1341] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:23.500754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cbc1-549b-4a66-be41-61aea48c1f20 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:23.501180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cbc1-549b-4a66-be41-61aea48c1f20 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:23.501298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22cbc1-549b-4a66-be41-61aea48c1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:23.507288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:23.573800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9e22cbc1-549b-4a66-be41-61aea48c1f20 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:23.575044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9e22cbc1-549b-4a66-be41-61aea48c1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:23.678177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 666/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:23.716266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5cedf-3115-4a57-b20e-a63052d52e70 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:23.718414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-74c5cedf-3115-4a57-b20e-a63052d52e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:23.767780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:23.818585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5cedf-3115-4a57-b20e-a63052d52e70 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:23.822185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594e2d7-c93a-4ce9-8e6e-5bdc3ce4a073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:23.822833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e2d7-c93a-4ce9-8e6e-5bdc3ce4a073 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:23.823118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e2d7-c93a-4ce9-8e6e-5bdc3ce4a073 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:23.823434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594e2d7-c93a-4ce9-8e6e-5bdc3ce4a073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:23.833340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594e2d7-c93a-4ce9-8e6e-5bdc3ce4a073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:23.835052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594e2d7-c93a-4ce9-8e6e-5bdc3ce4a073 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:23.844546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 677/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:26.523618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cddd-c6e2-4197-886d-41b68bf934dc None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:26.524150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cddd-c6e2-4197-886d-41b68bf934dc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:26.524150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570cddd-c6e2-4197-886d-41b68bf934dc None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:26.525577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 667/1344] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:26.530857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06ca0-a149-4aa7-9d9e-634410761f24 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:26.531278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06ca0-a149-4aa7-9d9e-634410761f24 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:26.531469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06ca0-a149-4aa7-9d9e-634410761f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:26.559463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-66c06ca0-a149-4aa7-9d9e-634410761f24 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:26.560640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-66c06ca0-a149-4aa7-9d9e-634410761f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:26.640774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 678/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:26.679443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570cddd-c6e2-4197-886d-41b68bf934dc None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:26.681242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0570cddd-c6e2-4197-886d-41b68bf934dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:26.694296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570cddd-c6e2-4197-886d-41b68bf934dc None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:26.697804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93039df8-3fff-4b51-bce4-d63d20256e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:26.698463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039df8-3fff-4b51-bce4-d63d20256e15 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:26.698747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039df8-3fff-4b51-bce4-d63d20256e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:26.699024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93039df8-3fff-4b51-bce4-d63d20256e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:26.709277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93039df8-3fff-4b51-bce4-d63d20256e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:26.710986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93039df8-3fff-4b51-bce4-d63d20256e15 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:26.721248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 668/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:30.660506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718529c-ea83-4929-b8fa-4347a39b07d4 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:30.661054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718529c-ea83-4929-b8fa-4347a39b07d4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:30.661054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718529c-ea83-4929-b8fa-4347a39b07d4 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:30.662441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 679/1347] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:30.667928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4f34d-aaa5-46e5-ac49-09d71119e694 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:30.668362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4f34d-aaa5-46e5-ac49-09d71119e694 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:30.668478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4f34d-aaa5-46e5-ac49-09d71119e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:30.688935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-36d4f34d-aaa5-46e5-ac49-09d71119e694 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:30.690140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-36d4f34d-aaa5-46e5-ac49-09d71119e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:30.699485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 669/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:30.736984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718529c-ea83-4929-b8fa-4347a39b07d4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:30.748403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718529c-ea83-4929-b8fa-4347a39b07d4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:30.751872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4922d-0b45-44b3-974e-e4efe4ea995f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:30.752511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4922d-0b45-44b3-974e-e4efe4ea995f service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:30.752793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4922d-0b45-44b3-974e-e4efe4ea995f service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:30.753066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4922d-0b45-44b3-974e-e4efe4ea995f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:30.762009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4922d-0b45-44b3-974e-e4efe4ea995f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:30.763474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4922d-0b45-44b3-974e-e4efe4ea995f service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:30.773212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 680/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:39:35.789079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ddfa0-513d-47a6-81ee-f57272595c2c None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:35.790004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ddfa0-513d-47a6-81ee-f57272595c2c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:35.790511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ddfa0-513d-47a6-81ee-f57272595c2c None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:35.795204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 670/1350] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:39:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:35.801006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfb79-1bac-4868-ab29-70a80aaa2a66 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:35.801759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfb79-1bac-4868-ab29-70a80aaa2a66 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:35.802196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74bfb79-1bac-4868-ab29-70a80aaa2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:35.885989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d74bfb79-1bac-4868-ab29-70a80aaa2a66 None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:35.887429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d74bfb79-1bac-4868-ab29-70a80aaa2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:35.938885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:35.994897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 681/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:39:40.212202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072fabb-e8d0-44d7-ad07-eaa5a0b35561 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:40.213145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072fabb-e8d0-44d7-ad07-eaa5a0b35561 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:40.213542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072fabb-e8d0-44d7-ad07-eaa5a0b35561 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:40.215093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 671/1352] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:40.220172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411fcf4-94a3-4459-8d81-99c780763330 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:40.231784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411fcf4-94a3-4459-8d81-99c780763330 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:40.232144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411fcf4-94a3-4459-8d81-99c780763330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:40.252214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6411fcf4-94a3-4459-8d81-99c780763330 None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:40.253774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6411fcf4-94a3-4459-8d81-99c780763330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:40.265240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 682/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:39:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:40.682692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=72 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:41.669215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bf79c-b2bd-4d39-ad4b-5ccb58b7b9db None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:41.669832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bf79c-b2bd-4d39-ad4b-5ccb58b7b9db None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:41.669832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06bf79c-b2bd-4d39-ad4b-5ccb58b7b9db None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:41.671119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 672/1354] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:41.676002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935f47-9b12-41c2-82ec-adb41dc5169c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:41.676424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935f47-9b12-41c2-82ec-adb41dc5169c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:41.676575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a935f47-9b12-41c2-82ec-adb41dc5169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:41.694132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2a935f47-9b12-41c2-82ec-adb41dc5169c None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:41.695329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2a935f47-9b12-41c2-82ec-adb41dc5169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:41.703731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 683/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:39:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:39:45.228770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc622c8-52f2-4a38-8c4e-31f810650fd4 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:45.230616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc622c8-52f2-4a38-8c4e-31f810650fd4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:45.230911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc622c8-52f2-4a38-8c4e-31f810650fd4 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:45.242339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 673/1356] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:45 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:45.248345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ebb71-d403-48cb-8315-10f33e5b35d3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:45.248816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ebb71-d403-48cb-8315-10f33e5b35d3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:45.249112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ebb71-d403-48cb-8315-10f33e5b35d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:45.267831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a64ebb71-d403-48cb-8315-10f33e5b35d3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:45.269727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a64ebb71-d403-48cb-8315-10f33e5b35d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:45.277782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 684/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:45.333734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1816-a1b8-4f53-9987-4206c1414bba None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:45.334554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1816-a1b8-4f53-9987-4206c1414bba None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:45.335087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1816-a1b8-4f53-9987-4206c1414bba None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:45.336934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 674/1358] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 13:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:45.345960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd0e5-7193-4c84-969c-52998bba5621 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:45.346440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd0e5-7193-4c84-969c-52998bba5621 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:45.346900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136dd0e5-7193-4c84-969c-52998bba5621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:45.400855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-136dd0e5-7193-4c84-969c-52998bba5621 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:45.402451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-136dd0e5-7193-4c84-969c-52998bba5621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:45.490277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 685/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 13:39:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:45.498818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1816-a1b8-4f53-9987-4206c1414bba None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:45.514161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1816-a1b8-4f53-9987-4206c1414bba None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:45.519801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f7fd1-37ba-4f45-933e-25c307362e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:45.520569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7fd1-37ba-4f45-933e-25c307362e44 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:45.520954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7fd1-37ba-4f45-933e-25c307362e44 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:45.521327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f7fd1-37ba-4f45-933e-25c307362e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:45.530060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f7fd1-37ba-4f45-933e-25c307362e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:45.531806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f7fd1-37ba-4f45-933e-25c307362e44 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:45.542120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 675/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:39:47.763747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874cdfd-5615-4872-ab93-4425b8fdec9a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:47.764287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874cdfd-5615-4872-ab93-4425b8fdec9a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:47.764287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874cdfd-5615-4872-ab93-4425b8fdec9a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:47.765662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 686/1361] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:47.771388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e7f9d-618a-45d0-9607-8712acba08c3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:47.771801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e7f9d-618a-45d0-9607-8712acba08c3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:47.771954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142e7f9d-618a-45d0-9607-8712acba08c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:47.790078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-142e7f9d-618a-45d0-9607-8712acba08c3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:47.791527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-142e7f9d-618a-45d0-9607-8712acba08c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:47.799467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 676/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:47.843271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874cdfd-5615-4872-ab93-4425b8fdec9a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:47.858505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874cdfd-5615-4872-ab93-4425b8fdec9a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:47.864648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbda3f2-cdba-4a09-85d1-ef8d876caccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:47.865388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda3f2-cdba-4a09-85d1-ef8d876caccd service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:47.865772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda3f2-cdba-4a09-85d1-ef8d876caccd service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:47.866146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbda3f2-cdba-4a09-85d1-ef8d876caccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:47.875426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbda3f2-cdba-4a09-85d1-ef8d876caccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:47.877132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbda3f2-cdba-4a09-85d1-ef8d876caccd service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:47.887444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 687/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:50.244690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b659c6-fc91-4399-a66b-4c958508591b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:50.245252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b659c6-fc91-4399-a66b-4c958508591b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:50.245252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b659c6-fc91-4399-a66b-4c958508591b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:50.246631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 677/1364] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:50.251679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1779ec7-2929-4124-836e-f87c52aefc86 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:50.252118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1779ec7-2929-4124-836e-f87c52aefc86 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:50.252319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1779ec7-2929-4124-836e-f87c52aefc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:50.277306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b1779ec7-2929-4124-836e-f87c52aefc86 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:50.278514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b1779ec7-2929-4124-836e-f87c52aefc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:50.298354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 688/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:50.332369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ddef1-37f3-48ca-993d-8da1e3f3e295 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:50.332662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ddef1-37f3-48ca-993d-8da1e3f3e295 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:50.332939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ddef1-37f3-48ca-993d-8da1e3f3e295 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:50.334556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 678/1366] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 13:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:50.339759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f47047-223d-45d7-ab83-87498e2dcc71 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:50.340060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f47047-223d-45d7-ab83-87498e2dcc71 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:50.340377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f47047-223d-45d7-ab83-87498e2dcc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:50.358459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-43f47047-223d-45d7-ab83-87498e2dcc71 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:50.359665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-43f47047-223d-45d7-ab83-87498e2dcc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:50.368650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 689/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 13:39:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:39:50.376214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ddef1-37f3-48ca-993d-8da1e3f3e295 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:50.390616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ddef1-37f3-48ca-993d-8da1e3f3e295 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:50.396671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc2d1-e0f1-4eb3-8a92-72169811910a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:50.397306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc2d1-e0f1-4eb3-8a92-72169811910a service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:50.397596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc2d1-e0f1-4eb3-8a92-72169811910a service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:50.397864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc2d1-e0f1-4eb3-8a92-72169811910a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:50.405774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc2d1-e0f1-4eb3-8a92-72169811910a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:50.407367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc2d1-e0f1-4eb3-8a92-72169811910a service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:50.417347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 679/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:52.512744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9331f-e0e6-4e1c-919e-8088f04d9ef9 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:52.513268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9331f-e0e6-4e1c-919e-8088f04d9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:52.513384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9331f-e0e6-4e1c-919e-8088f04d9ef9 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:52.514675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 690/1369] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:52.521466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3246-4cc3-4a44-9fb4-7a000c7a7232 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:52.522265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3246-4cc3-4a44-9fb4-7a000c7a7232 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:52.522551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e3246-4cc3-4a44-9fb4-7a000c7a7232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:52.540779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-bd0e3246-4cc3-4a44-9fb4-7a000c7a7232 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:52.542635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bd0e3246-4cc3-4a44-9fb4-7a000c7a7232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:52.551975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 680/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:52.601410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9331f-e0e6-4e1c-919e-8088f04d9ef9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:52.615920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9331f-e0e6-4e1c-919e-8088f04d9ef9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:52.621288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51840b-c605-43e7-94fc-31d4bceb79d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:52.622028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51840b-c605-43e7-94fc-31d4bceb79d5 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:52.622410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51840b-c605-43e7-94fc-31d4bceb79d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:52.622787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51840b-c605-43e7-94fc-31d4bceb79d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:52.631881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51840b-c605-43e7-94fc-31d4bceb79d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:52.633584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51840b-c605-43e7-94fc-31d4bceb79d5 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:52.644513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 691/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:53.255503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d218f4-045f-4571-9f8f-ca871be3f430 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:53.255796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d218f4-045f-4571-9f8f-ca871be3f430 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:53.256079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d218f4-045f-4571-9f8f-ca871be3f430 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:53.257463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 681/1372] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:53.263212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9506c-c0c7-446b-9028-580abd4b1468 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:53.263765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9506c-c0c7-446b-9028-580abd4b1468 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:53.264075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9506c-c0c7-446b-9028-580abd4b1468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:53.282192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8bd9506c-c0c7-446b-9028-580abd4b1468 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:53.283402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8bd9506c-c0c7-446b-9028-580abd4b1468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:53.291285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 692/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:53.629966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498aa86-73ae-4e4a-9931-6c7a6730cedf None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:53.629966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498aa86-73ae-4e4a-9931-6c7a6730cedf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:53.629966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498aa86-73ae-4e4a-9931-6c7a6730cedf None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:53.631834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 682/1374] 10.222.0.25 () {54 vars in 963 bytes} [Wed Jul 6 13:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:53.635744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168074-74ab-4cda-b9eb-c56a69679203 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:53.636182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168074-74ab-4cda-b9eb-c56a69679203 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:53.636328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91168074-74ab-4cda-b9eb-c56a69679203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:53.643842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:39:53.686887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-91168074-74ab-4cda-b9eb-c56a69679203 None None] MFA Rules not processed for user `695790c0f33f40e1a0ea7e70318d419a`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:53.688113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-91168074-74ab-4cda-b9eb-c56a69679203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:53.750051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 693/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Wed Jul 6 13:39:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:53.758300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498aa86-73ae-4e4a-9931-6c7a6730cedf None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:53.768935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498aa86-73ae-4e4a-9931-6c7a6730cedf None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:53.772359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba3189-efe0-4f6a-b743-236c5f12a0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:53.773001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3189-efe0-4f6a-b743-236c5f12a0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:53.773277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3189-efe0-4f6a-b743-236c5f12a0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:53.773555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba3189-efe0-4f6a-b743-236c5f12a0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:53.782757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba3189-efe0-4f6a-b743-236c5f12a0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:53.787109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba3189-efe0-4f6a-b743-236c5f12a0d0 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:53.795143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 683/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:54.733300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f671a5-bc0a-4bb0-92fd-f625744d4d6d None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:54.733816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f671a5-bc0a-4bb0-92fd-f625744d4d6d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:54.733952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f671a5-bc0a-4bb0-92fd-f625744d4d6d None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:54.735250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 694/1377] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:54.740590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481879-f9a3-4fc1-9f26-4336d06c4117 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:54.741035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481879-f9a3-4fc1-9f26-4336d06c4117 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:54.741129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481879-f9a3-4fc1-9f26-4336d06c4117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:54.761042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-02481879-f9a3-4fc1-9f26-4336d06c4117 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:54.762304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-02481879-f9a3-4fc1-9f26-4336d06c4117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:54.770673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 684/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:54.813285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f671a5-bc0a-4bb0-92fd-f625744d4d6d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:54.828199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f671a5-bc0a-4bb0-92fd-f625744d4d6d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:54.835203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb8714-a7d5-49d0-9273-2791b825421b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:54.835880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb8714-a7d5-49d0-9273-2791b825421b service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:54.836173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb8714-a7d5-49d0-9273-2791b825421b service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:54.836456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb8714-a7d5-49d0-9273-2791b825421b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:54.845138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb8714-a7d5-49d0-9273-2791b825421b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:54.846823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feb8714-a7d5-49d0-9273-2791b825421b service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:54.858337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 695/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:56.891980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a9904-afb5-44f4-9f75-06e02c228734 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:56.892455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a9904-afb5-44f4-9f75-06e02c228734 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:56.892557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a9904-afb5-44f4-9f75-06e02c228734 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:56.893964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 685/1380] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:56.899371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e932-bd41-4484-a239-c7d7b3237624 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:56.899804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e932-bd41-4484-a239-c7d7b3237624 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:56.899940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68e932-bd41-4484-a239-c7d7b3237624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:56.917542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2e68e932-bd41-4484-a239-c7d7b3237624 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:56.918709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2e68e932-bd41-4484-a239-c7d7b3237624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:56.926900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 696/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:56.970268 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a9904-afb5-44f4-9f75-06e02c228734 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:56.984872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a9904-afb5-44f4-9f75-06e02c228734 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:56.990661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ce93c-1b89-4bc2-a3bf-9dbeb379befd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:56.991294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce93c-1b89-4bc2-a3bf-9dbeb379befd service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:56.991607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce93c-1b89-4bc2-a3bf-9dbeb379befd service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:56.991883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ce93c-1b89-4bc2-a3bf-9dbeb379befd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:56.999935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ce93c-1b89-4bc2-a3bf-9dbeb379befd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:57.001501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ce93c-1b89-4bc2-a3bf-9dbeb379befd service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:57.010693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 686/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:39:59.057870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44370-6319-47de-bf83-f84c17639603 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:59.058402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44370-6319-47de-bf83-f84c17639603 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:59.058402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb44370-6319-47de-bf83-f84c17639603 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:59.059817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 697/1383] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:39:59.065183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534ac2-2323-4fc9-99fb-0eef682b03ee None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:59.065612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534ac2-2323-4fc9-99fb-0eef682b03ee None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:59.066084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c534ac2-2323-4fc9-99fb-0eef682b03ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:59.085851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5c534ac2-2323-4fc9-99fb-0eef682b03ee None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:39:59.087171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5c534ac2-2323-4fc9-99fb-0eef682b03ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:39:59.095140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 687/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:39:59.135582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44370-6319-47de-bf83-f84c17639603 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:39:59.150645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb44370-6319-47de-bf83-f84c17639603 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:39:59.155942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2ef89-9cd2-48c2-9631-711b2ec3c259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:39:59.156580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ef89-9cd2-48c2-9631-711b2ec3c259 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:39:59.156862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ef89-9cd2-48c2-9631-711b2ec3c259 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:39:59.157132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2ef89-9cd2-48c2-9631-711b2ec3c259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:39:59.166758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2ef89-9cd2-48c2-9631-711b2ec3c259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:39:59.168387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2ef89-9cd2-48c2-9631-711b2ec3c259 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:39:59.179242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 698/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:01.213409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1c19-ac57-44f7-abfe-03d115a11aa2 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:01.214062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1c19-ac57-44f7-abfe-03d115a11aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:01.214062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad1c19-ac57-44f7-abfe-03d115a11aa2 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:01.220584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411631-a199-4b33-8a5b-2739486c9059 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:01.220584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411631-a199-4b33-8a5b-2739486c9059 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:01.221372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411631-a199-4b33-8a5b-2739486c9059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:01.222941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 688/1386] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:40:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:01.245149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-10411631-a199-4b33-8a5b-2739486c9059 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:01.246445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-10411631-a199-4b33-8a5b-2739486c9059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:01.256200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 699/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:40:01.300545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1c19-ac57-44f7-abfe-03d115a11aa2 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:01.315731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad1c19-ac57-44f7-abfe-03d115a11aa2 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:01.321941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becaeeb-e05c-4382-95f1-07af6eb785b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:01.322581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becaeeb-e05c-4382-95f1-07af6eb785b0 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:01.322867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becaeeb-e05c-4382-95f1-07af6eb785b0 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:01.323145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becaeeb-e05c-4382-95f1-07af6eb785b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:01.331980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becaeeb-e05c-4382-95f1-07af6eb785b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:01.333596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becaeeb-e05c-4382-95f1-07af6eb785b0 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:01.343553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 689/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:03.404246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeed76-397e-4e37-b0fd-f494aa749b4a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:03.406604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeed76-397e-4e37-b0fd-f494aa749b4a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:03.406604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aeed76-397e-4e37-b0fd-f494aa749b4a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:03.406604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 700/1389] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:03.412291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791f68-e8b6-405c-9e7a-fb519a206844 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:03.412718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791f68-e8b6-405c-9e7a-fb519a206844 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:03.413011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4791f68-e8b6-405c-9e7a-fb519a206844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:03.432878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f4791f68-e8b6-405c-9e7a-fb519a206844 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:03.434066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f4791f68-e8b6-405c-9e7a-fb519a206844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:03.442523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 690/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:03.486522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeed76-397e-4e37-b0fd-f494aa749b4a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:03.503778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aeed76-397e-4e37-b0fd-f494aa749b4a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:03.509148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70e917-fa6b-4601-9960-932e3d7d37a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:03.509785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e917-fa6b-4601-9960-932e3d7d37a7 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:03.510067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e917-fa6b-4601-9960-932e3d7d37a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:03.510342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70e917-fa6b-4601-9960-932e3d7d37a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:03.518672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70e917-fa6b-4601-9960-932e3d7d37a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:03.520288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70e917-fa6b-4601-9960-932e3d7d37a7 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:03.529731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 701/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:05.873654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79db4-80e4-4818-8df2-b084fedcb8da None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:05.874327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79db4-80e4-4818-8df2-b084fedcb8da None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:05.874327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a79db4-80e4-4818-8df2-b084fedcb8da None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:05.875680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 691/1392] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:05.881565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b96a-e07f-4361-8f28-664001a3f9d4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:05.882003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b96a-e07f-4361-8f28-664001a3f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:05.882103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4b96a-e07f-4361-8f28-664001a3f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:05.899840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-96d4b96a-e07f-4361-8f28-664001a3f9d4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:05.901051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-96d4b96a-e07f-4361-8f28-664001a3f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:05.909176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 702/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:05.953998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a79db4-80e4-4818-8df2-b084fedcb8da None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:05.968721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a79db4-80e4-4818-8df2-b084fedcb8da None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:05.974713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2ba62-5e3b-4b4e-8c74-e6017e287f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:05.975443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ba62-5e3b-4b4e-8c74-e6017e287f48 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:05.975948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ba62-5e3b-4b4e-8c74-e6017e287f48 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:05.976085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2ba62-5e3b-4b4e-8c74-e6017e287f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:05.984240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2ba62-5e3b-4b4e-8c74-e6017e287f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:05.985873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2ba62-5e3b-4b4e-8c74-e6017e287f48 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:05.995859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 692/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:08.213466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0661eb-6756-444b-aba2-803513cd2b66 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.213994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0661eb-6756-444b-aba2-803513cd2b66 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.213994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0661eb-6756-444b-aba2-803513cd2b66 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:08.215308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 703/1395] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:08.220373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffaf54-ecde-4ae7-a6f2-d8523d279a44 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.221387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffaf54-ecde-4ae7-a6f2-d8523d279a44 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.221588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffaf54-ecde-4ae7-a6f2-d8523d279a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:08.239381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a4ffaf54-ecde-4ae7-a6f2-d8523d279a44 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:08.240574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a4ffaf54-ecde-4ae7-a6f2-d8523d279a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:08.248373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 693/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:08.291582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0661eb-6756-444b-aba2-803513cd2b66 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:08.305983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0661eb-6756-444b-aba2-803513cd2b66 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:08.311334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5b91a-0027-410a-b03a-2c127928f447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:08.312053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b91a-0027-410a-b03a-2c127928f447 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.312340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b91a-0027-410a-b03a-2c127928f447 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.312665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b91a-0027-410a-b03a-2c127928f447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:08.321813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5b91a-0027-410a-b03a-2c127928f447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:08.323433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5b91a-0027-410a-b03a-2c127928f447 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:08.333519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 704/1397] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:08.895027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a776-37e3-4c7b-9c66-01e475896e09 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.895231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a776-37e3-4c7b-9c66-01e475896e09 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.895534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a776-37e3-4c7b-9c66-01e475896e09 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:08.896900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 694/1398] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:40:08.901979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6188-b938-421c-8f88-14919da1576f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.902348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6188-b938-421c-8f88-14919da1576f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.902640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc6188-b938-421c-8f88-14919da1576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:08.920242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-75cc6188-b938-421c-8f88-14919da1576f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:08.921441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-75cc6188-b938-421c-8f88-14919da1576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:08.929803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 705/1399] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:40:08.984820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010c2d-3a12-4913-8fed-ff0bd3f9b8dd None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.985118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010c2d-3a12-4913-8fed-ff0bd3f9b8dd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.985400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6010c2d-3a12-4913-8fed-ff0bd3f9b8dd None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:08.987390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 695/1400] 10.222.0.25 () {54 vars in 962 bytes} [Wed Jul 6 13:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:08.992329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eda0e-2aec-449d-a401-ea5da9d535b2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:08.992642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eda0e-2aec-449d-a401-ea5da9d535b2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:08.993185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008eda0e-2aec-449d-a401-ea5da9d535b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:09.040969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-008eda0e-2aec-449d-a401-ea5da9d535b2 None None] MFA Rules not processed for user `e9625fcd053644e3914df6762e067788`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:09.042161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-008eda0e-2aec-449d-a401-ea5da9d535b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:09.074373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:40:09.102408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 706/1401] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Jul 6 13:40:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:09.109894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6010c2d-3a12-4913-8fed-ff0bd3f9b8dd None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:09.120998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6010c2d-3a12-4913-8fed-ff0bd3f9b8dd None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:09.124472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbcd3-f95e-4aee-bf20-61a8247710c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:09.125098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbcd3-f95e-4aee-bf20-61a8247710c0 service glance] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:09.125374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbcd3-f95e-4aee-bf20-61a8247710c0 service glance] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:09.125645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbcd3-f95e-4aee-bf20-61a8247710c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:09.134581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbcd3-f95e-4aee-bf20-61a8247710c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:09.136031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbcd3-f95e-4aee-bf20-61a8247710c0 service glance] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:09.145156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 696/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:09.866162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57edc83-2a39-423b-b967-5fb29e743ed4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:09.866638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57edc83-2a39-423b-b967-5fb29e743ed4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:09.866748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57edc83-2a39-423b-b967-5fb29e743ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:09.914117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e57edc83-2a39-423b-b967-5fb29e743ed4 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:09.915376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e57edc83-2a39-423b-b967-5fb29e743ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:09.978767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 707/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:40:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:10.019387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6c73-bac0-4d0a-9d3a-aebdd0d3330b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:10.019889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6c73-bac0-4d0a-9d3a-aebdd0d3330b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:10.020219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c6c73-bac0-4d0a-9d3a-aebdd0d3330b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:10.021650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 697/1404] 10.222.0.25 () {54 vars in 942 bytes} [Wed Jul 6 13:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:10.027863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1716b9-8b72-4f9b-b6d1-0b32d779cd00 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:10.028155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1716b9-8b72-4f9b-b6d1-0b32d779cd00 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:10.028437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1716b9-8b72-4f9b-b6d1-0b32d779cd00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:10.077052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fa1716b9-8b72-4f9b-b6d1-0b32d779cd00 None None] MFA Rules not processed for user `497f17edb85d4ed999f24690f5bc0ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:10.078369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fa1716b9-8b72-4f9b-b6d1-0b32d779cd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:10.150285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 708/1405] 10.222.0.25 () {58 vars in 1039 bytes} [Wed Jul 6 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:10.159837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6c73-bac0-4d0a-9d3a-aebdd0d3330b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:10.172832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c6c73-bac0-4d0a-9d3a-aebdd0d3330b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:10.178747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1ff72-e12a-428f-a531-a2978c900db5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:10.179401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ff72-e12a-428f-a531-a2978c900db5 service swift] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:10.179683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ff72-e12a-428f-a531-a2978c900db5 service swift] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:10.179956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1ff72-e12a-428f-a531-a2978c900db5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:10.187787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1ff72-e12a-428f-a531-a2978c900db5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:10.189366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d1ff72-e12a-428f-a531-a2978c900db5 service swift] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:10.197637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 698/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:40:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:40:10.399814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420fd2-3cbd-4a8f-b9f1-3c4b37fb1729 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:10.400189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420fd2-3cbd-4a8f-b9f1-3c4b37fb1729 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:10.400539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43420fd2-3cbd-4a8f-b9f1-3c4b37fb1729 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:10.401983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 709/1407] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:10.407170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b4b7-836e-48ae-864e-032dca53a547 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:10.407688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b4b7-836e-48ae-864e-032dca53a547 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:10.407966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76b4b7-836e-48ae-864e-032dca53a547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:10.426950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-cd76b4b7-836e-48ae-864e-032dca53a547 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:10.428199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cd76b4b7-836e-48ae-864e-032dca53a547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:10.436403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 699/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:10.481494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43420fd2-3cbd-4a8f-b9f1-3c4b37fb1729 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:10.498240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43420fd2-3cbd-4a8f-b9f1-3c4b37fb1729 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:10.505079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd549ee0-3e8e-4d42-bd53-5ff1f21cbe4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:10.505736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549ee0-3e8e-4d42-bd53-5ff1f21cbe4b service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:10.506016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549ee0-3e8e-4d42-bd53-5ff1f21cbe4b service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:10.506288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd549ee0-3e8e-4d42-bd53-5ff1f21cbe4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:10.515203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd549ee0-3e8e-4d42-bd53-5ff1f21cbe4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:10.516862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd549ee0-3e8e-4d42-bd53-5ff1f21cbe4b service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:10.522385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:40:10.530526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 710/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:20.421468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=69 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:40:32.258562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3511ab3-a6a5-4146-ae28-d7f41c060d5d None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:32.259184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3511ab3-a6a5-4146-ae28-d7f41c060d5d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:32.259184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3511ab3-a6a5-4146-ae28-d7f41c060d5d None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:32.260437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 700/1410] 10.222.0.25 () {54 vars in 918 bytes} [Wed Jul 6 13:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:32.265594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e562-f548-4311-bd37-659239eec10f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:32.266039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e562-f548-4311-bd37-659239eec10f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:32.266140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e562-f548-4311-bd37-659239eec10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:32.284008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7557e562-f548-4311-bd37-659239eec10f None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:32.285186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7557e562-f548-4311-bd37-659239eec10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:32.293325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 711/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Jul 6 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:32.307730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92768f-ae82-4933-bd11-bd8e9fdc84a0 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:32.308021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92768f-ae82-4933-bd11-bd8e9fdc84a0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:32.308301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92768f-ae82-4933-bd11-bd8e9fdc84a0 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:32.309612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 701/1412] 10.222.0.25 () {54 vars in 918 bytes} [Wed Jul 6 13:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:32.314060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb49c7-e92e-4099-9e39-5f34e9641da3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:32.314345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb49c7-e92e-4099-9e39-5f34e9641da3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:32.314649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb49c7-e92e-4099-9e39-5f34e9641da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:32.331889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7fbb49c7-e92e-4099-9e39-5f34e9641da3 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:32.333043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7fbb49c7-e92e-4099-9e39-5f34e9641da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:32.342114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 712/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Wed Jul 6 13:40:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:34.833684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1758c60-21f9-4ce5-be8b-0ace505fb7f1 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:34.834182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1758c60-21f9-4ce5-be8b-0ace505fb7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:34.834289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1758c60-21f9-4ce5-be8b-0ace505fb7f1 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:34.835886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:34.841044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776670-87d0-43b0-be99-98585e7b4d7f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:34.841439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776670-87d0-43b0-be99-98585e7b4d7f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:34.841601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b776670-87d0-43b0-be99-98585e7b4d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:34.858807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6b776670-87d0-43b0-be99-98585e7b4d7f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:34.860043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6b776670-87d0-43b0-be99-98585e7b4d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:34.868293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:34.911128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1758c60-21f9-4ce5-be8b-0ace505fb7f1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:34.926210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1758c60-21f9-4ce5-be8b-0ace505fb7f1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:34.931603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a673167-8e3b-4fe4-bc4d-05ec4ab0ea9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:34.932239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a673167-8e3b-4fe4-bc4d-05ec4ab0ea9b service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:34.932522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a673167-8e3b-4fe4-bc4d-05ec4ab0ea9b service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:34.932798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a673167-8e3b-4fe4-bc4d-05ec4ab0ea9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:34.941513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a673167-8e3b-4fe4-bc4d-05ec4ab0ea9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:34.943093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a673167-8e3b-4fe4-bc4d-05ec4ab0ea9b service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:34.952338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 703/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:35.853247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf86-d471-4c34-9c9e-eb4329e72bd8 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:35.853762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf86-d471-4c34-9c9e-eb4329e72bd8 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:35.853889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0bf86-d471-4c34-9c9e-eb4329e72bd8 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:35.855209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:35.860031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313f1e-cebc-4d60-bc6c-93e04082572f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:35.860430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313f1e-cebc-4d60-bc6c-93e04082572f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:35.860598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63313f1e-cebc-4d60-bc6c-93e04082572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:35.878431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-63313f1e-cebc-4d60-bc6c-93e04082572f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:35.879680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-63313f1e-cebc-4d60-bc6c-93e04082572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:35.887370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:36.037328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0bf86-d471-4c34-9c9e-eb4329e72bd8 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:36.051464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0bf86-d471-4c34-9c9e-eb4329e72bd8 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:36.056711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ded2f-34f9-401a-ab0a-e58d68a52ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:36.057464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ded2f-34f9-401a-ab0a-e58d68a52ad9 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:36.057699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ded2f-34f9-401a-ab0a-e58d68a52ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:36.057972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ded2f-34f9-401a-ab0a-e58d68a52ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:36.066358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ded2f-34f9-401a-ab0a-e58d68a52ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:36.067998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ded2f-34f9-401a-ab0a-e58d68a52ad9 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:36.077378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 715/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:36.948135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b203-ce9f-475c-9b23-40b820a172f5 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:36.948632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b203-ce9f-475c-9b23-40b820a172f5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:36.948632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82b203-ce9f-475c-9b23-40b820a172f5 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:36.949987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:36.954711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8dc8-c4b0-4bc8-942a-286f27e81400 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:36.955146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8dc8-c4b0-4bc8-942a-286f27e81400 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:36.955256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8dc8-c4b0-4bc8-942a-286f27e81400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:36.973640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e0ff8dc8-c4b0-4bc8-942a-286f27e81400 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:36.974824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e0ff8dc8-c4b0-4bc8-942a-286f27e81400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:36.982511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:37.131581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b203-ce9f-475c-9b23-40b820a172f5 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:37.146200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82b203-ce9f-475c-9b23-40b820a172f5 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:37.151449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee3447-f379-4598-be06-9fddc48de7bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:37.152079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3447-f379-4598-be06-9fddc48de7bf service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:37.152361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3447-f379-4598-be06-9fddc48de7bf service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:37.152658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee3447-f379-4598-be06-9fddc48de7bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:37.161126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3447-f379-4598-be06-9fddc48de7bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:37.162688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee3447-f379-4598-be06-9fddc48de7bf service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:37.171838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 706/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:38.017744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a2f4f-6956-49c1-90cd-ff7981827b74 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:38.018312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a2f4f-6956-49c1-90cd-ff7981827b74 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:38.018312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a2f4f-6956-49c1-90cd-ff7981827b74 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:38.019722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:38.024598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0e60c-43d2-4176-a9ab-168b91b48669 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:38.025025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0e60c-43d2-4176-a9ab-168b91b48669 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:38.025141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0e60c-43d2-4176-a9ab-168b91b48669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:38.042664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-57d0e60c-43d2-4176-a9ab-168b91b48669 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:38.043887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-57d0e60c-43d2-4176-a9ab-168b91b48669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:38.052120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:38.198820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a2f4f-6956-49c1-90cd-ff7981827b74 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:38.212990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a2f4f-6956-49c1-90cd-ff7981827b74 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:38.218213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b92b90-c92a-40f8-8390-e241a23b7dc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:38.218835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b92b90-c92a-40f8-8390-e241a23b7dc4 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:38.219116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b92b90-c92a-40f8-8390-e241a23b7dc4 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:38.219421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b92b90-c92a-40f8-8390-e241a23b7dc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:38.232060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b92b90-c92a-40f8-8390-e241a23b7dc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:38.233637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b92b90-c92a-40f8-8390-e241a23b7dc4 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:38.243662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 718/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:39.092661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b3a6-0db8-4484-8c8e-a4771b10612c None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:39.093211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b3a6-0db8-4484-8c8e-a4771b10612c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:39.093211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e519b3a6-0db8-4484-8c8e-a4771b10612c None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:39.094606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:39.100053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77e1c-b503-4bf1-8608-833c0838c7d3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:39.100483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77e1c-b503-4bf1-8608-833c0838c7d3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:39.100654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e77e1c-b503-4bf1-8608-833c0838c7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:39.118879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c9e77e1c-b503-4bf1-8608-833c0838c7d3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:39.120101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c9e77e1c-b503-4bf1-8608-833c0838c7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:39.128106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:39.275819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519b3a6-0db8-4484-8c8e-a4771b10612c None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:39.290408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e519b3a6-0db8-4484-8c8e-a4771b10612c None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:39.295722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55669903-f794-4cee-af97-29f5edee3d77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:39.296351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669903-f794-4cee-af97-29f5edee3d77 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:39.296638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669903-f794-4cee-af97-29f5edee3d77 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:39.296912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55669903-f794-4cee-af97-29f5edee3d77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:39.305686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55669903-f794-4cee-af97-29f5edee3d77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:39.307298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55669903-f794-4cee-af97-29f5edee3d77 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:39.316809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 709/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:40.118761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312676-af32-4d3a-9463-efa2d36e9744 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:40.119288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312676-af32-4d3a-9463-efa2d36e9744 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:40.119288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1312676-af32-4d3a-9463-efa2d36e9744 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:40.120625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:40.125599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58c7a-7b52-4f10-8703-811dedc6daee None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:40.126006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58c7a-7b52-4f10-8703-811dedc6daee None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:40.126159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb58c7a-7b52-4f10-8703-811dedc6daee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:40.144714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9bb58c7a-7b52-4f10-8703-811dedc6daee None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:40.145911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9bb58c7a-7b52-4f10-8703-811dedc6daee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:40.153615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:40:40.300367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1312676-af32-4d3a-9463-efa2d36e9744 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:40.314649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1312676-af32-4d3a-9463-efa2d36e9744 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:40.320488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca80cf-ffe7-4836-b040-7adaa8e0fd42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:40.321118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca80cf-ffe7-4836-b040-7adaa8e0fd42 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:40.321402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca80cf-ffe7-4836-b040-7adaa8e0fd42 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:40.321677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca80cf-ffe7-4836-b040-7adaa8e0fd42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:40.329597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca80cf-ffe7-4836-b040-7adaa8e0fd42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:40.331201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca80cf-ffe7-4836-b040-7adaa8e0fd42 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:40.340782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 721/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:41.135831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdba9e-00ee-4838-a49e-03d6d489fe01 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:41.136425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdba9e-00ee-4838-a49e-03d6d489fe01 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:41.136425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdba9e-00ee-4838-a49e-03d6d489fe01 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:41.137722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:41.142484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668861dd-a7ef-4b2a-a026-0b6f48514000 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:41.143452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668861dd-a7ef-4b2a-a026-0b6f48514000 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:41.143781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668861dd-a7ef-4b2a-a026-0b6f48514000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:41.161912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-668861dd-a7ef-4b2a-a026-0b6f48514000 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:41.163114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-668861dd-a7ef-4b2a-a026-0b6f48514000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:41.170757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:41.317776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdba9e-00ee-4838-a49e-03d6d489fe01 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:41.332484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdba9e-00ee-4838-a49e-03d6d489fe01 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:41.338049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e8570-7770-4b6f-af0c-b10fa59502ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:41.338712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e8570-7770-4b6f-af0c-b10fa59502ea service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:41.338992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e8570-7770-4b6f-af0c-b10fa59502ea service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:41.339291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e8570-7770-4b6f-af0c-b10fa59502ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:41.347290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e8570-7770-4b6f-af0c-b10fa59502ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:41.348881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e8570-7770-4b6f-af0c-b10fa59502ea service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:41.357961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 712/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:42.160909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9aee-3578-49f1-96bd-2891b687f6b5 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:42.161461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9aee-3578-49f1-96bd-2891b687f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:42.161461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9aee-3578-49f1-96bd-2891b687f6b5 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:42.162752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:42.167632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867aefb-de0c-468b-bd55-d8a5f01cea87 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:42.168076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867aefb-de0c-468b-bd55-d8a5f01cea87 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:42.168245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867aefb-de0c-468b-bd55-d8a5f01cea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:42.186121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b867aefb-de0c-468b-bd55-d8a5f01cea87 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:42.187302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b867aefb-de0c-468b-bd55-d8a5f01cea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:42.194919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:42.342545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9aee-3578-49f1-96bd-2891b687f6b5 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:42.357132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9aee-3578-49f1-96bd-2891b687f6b5 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:42.363100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54160ff-1f7a-4489-be49-fc5ec23cd220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:42.363758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54160ff-1f7a-4489-be49-fc5ec23cd220 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:42.364059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54160ff-1f7a-4489-be49-fc5ec23cd220 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:42.364315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54160ff-1f7a-4489-be49-fc5ec23cd220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:42.372260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54160ff-1f7a-4489-be49-fc5ec23cd220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:42.373843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54160ff-1f7a-4489-be49-fc5ec23cd220 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:42.383141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 724/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:43.188499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756313a1-9659-4afc-9da9-56c02c06b003 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:43.189032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756313a1-9659-4afc-9da9-56c02c06b003 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:43.189032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756313a1-9659-4afc-9da9-56c02c06b003 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:43.190979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:43.195879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069abf-1c2e-4ff8-befd-5cf57f77f372 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:43.196308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069abf-1c2e-4ff8-befd-5cf57f77f372 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:43.196437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069abf-1c2e-4ff8-befd-5cf57f77f372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:43.214053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c9069abf-1c2e-4ff8-befd-5cf57f77f372 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:43.215228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c9069abf-1c2e-4ff8-befd-5cf57f77f372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:43.223124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:43.370364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756313a1-9659-4afc-9da9-56c02c06b003 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:43.385061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756313a1-9659-4afc-9da9-56c02c06b003 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:43.390466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860c009f-68bc-46c8-b618-6544122571b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:43.391126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c009f-68bc-46c8-b618-6544122571b1 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:43.391440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c009f-68bc-46c8-b618-6544122571b1 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:43.391750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860c009f-68bc-46c8-b618-6544122571b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:43.399735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c009f-68bc-46c8-b618-6544122571b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:43.401304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860c009f-68bc-46c8-b618-6544122571b1 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:43.410489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 715/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:45.327025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde25b8-c1da-40c1-826f-e2c3c9517eeb None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:45.327656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde25b8-c1da-40c1-826f-e2c3c9517eeb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:45.327656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde25b8-c1da-40c1-826f-e2c3c9517eeb None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:45.328973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:45.334314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71778f3-cb35-4866-b097-56cbc1d588ef None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:45.334748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71778f3-cb35-4866-b097-56cbc1d588ef None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:45.334899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71778f3-cb35-4866-b097-56cbc1d588ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:45.352910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b71778f3-cb35-4866-b097-56cbc1d588ef None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:45.354087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b71778f3-cb35-4866-b097-56cbc1d588ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:45.361660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:45.399719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde25b8-c1da-40c1-826f-e2c3c9517eeb None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:45.410921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde25b8-c1da-40c1-826f-e2c3c9517eeb None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:45.414399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817ea83-8293-4d6b-9994-34bc5c9b33f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:45.415025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ea83-8293-4d6b-9994-34bc5c9b33f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:45.415311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ea83-8293-4d6b-9994-34bc5c9b33f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:45.415611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817ea83-8293-4d6b-9994-34bc5c9b33f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:45.424286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ea83-8293-4d6b-9994-34bc5c9b33f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:45.425698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817ea83-8293-4d6b-9994-34bc5c9b33f0 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:45.434958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 727/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:47.615909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772be52-02b0-4264-b8b8-38d65bd3875e None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:47.616481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772be52-02b0-4264-b8b8-38d65bd3875e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:47.616481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772be52-02b0-4264-b8b8-38d65bd3875e None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:47.617870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:47.623086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f1ff-acb5-47da-835e-b3ed8af5234a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:47.623552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f1ff-acb5-47da-835e-b3ed8af5234a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:47.623670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0f1ff-acb5-47da-835e-b3ed8af5234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:47.641803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-0af0f1ff-acb5-47da-835e-b3ed8af5234a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:47.643022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0af0f1ff-acb5-47da-835e-b3ed8af5234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:47.650697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:47.687961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772be52-02b0-4264-b8b8-38d65bd3875e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:47.699091 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772be52-02b0-4264-b8b8-38d65bd3875e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:47.702583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b038c-584c-4c11-a88f-5e6bfd77658c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:47.703216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b038c-584c-4c11-a88f-5e6bfd77658c service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:47.703534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b038c-584c-4c11-a88f-5e6bfd77658c service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:47.703814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b038c-584c-4c11-a88f-5e6bfd77658c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:47.712904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b038c-584c-4c11-a88f-5e6bfd77658c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:47.714324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b038c-584c-4c11-a88f-5e6bfd77658c service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:47.723708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 718/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:50.028733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd4be-4e3f-4d24-80e8-6eaf6a1b996a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:50.029280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd4be-4e3f-4d24-80e8-6eaf6a1b996a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:50.029280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fd4be-4e3f-4d24-80e8-6eaf6a1b996a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:50.030593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:50.036531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce90b-7483-4a0a-bb71-6827a1c387bd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:50.036936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce90b-7483-4a0a-bb71-6827a1c387bd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:50.037087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce90b-7483-4a0a-bb71-6827a1c387bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:50.054461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-78bce90b-7483-4a0a-bb71-6827a1c387bd None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:50.055679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-78bce90b-7483-4a0a-bb71-6827a1c387bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:50.063258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:50.102355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd4be-4e3f-4d24-80e8-6eaf6a1b996a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:50.112918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fd4be-4e3f-4d24-80e8-6eaf6a1b996a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:50.116350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e73e1-fa70-400a-abfb-e6863f735c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:50.116974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e73e1-fa70-400a-abfb-e6863f735c46 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:50.117254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e73e1-fa70-400a-abfb-e6863f735c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:50.117524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e73e1-fa70-400a-abfb-e6863f735c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:50.126132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e73e1-fa70-400a-abfb-e6863f735c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:50.127600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e73e1-fa70-400a-abfb-e6863f735c46 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:50.136733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 730/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:52.279237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ca5a-a0e8-4c2c-b0c9-997a1683503d None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:52.279817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ca5a-a0e8-4c2c-b0c9-997a1683503d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:52.279817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892ca5a-a0e8-4c2c-b0c9-997a1683503d None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:52.281097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:52.286260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5091399-200b-441d-908b-f69f80b07015 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:52.286659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5091399-200b-441d-908b-f69f80b07015 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:52.286826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5091399-200b-441d-908b-f69f80b07015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:52.304664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a5091399-200b-441d-908b-f69f80b07015 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:52.305852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a5091399-200b-441d-908b-f69f80b07015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:52.313497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:52.351288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ca5a-a0e8-4c2c-b0c9-997a1683503d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:52.362489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892ca5a-a0e8-4c2c-b0c9-997a1683503d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:52.365945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8071b-7c34-4858-bc8b-6e88c913ca8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:52.366583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8071b-7c34-4858-bc8b-6e88c913ca8f service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:52.366867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8071b-7c34-4858-bc8b-6e88c913ca8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:52.367143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8071b-7c34-4858-bc8b-6e88c913ca8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:52.375742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8071b-7c34-4858-bc8b-6e88c913ca8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:52.377162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8071b-7c34-4858-bc8b-6e88c913ca8f service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:52.387574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 721/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:40:54.525860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d3d-0698-448d-ad3c-9623d6cc7b87 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:54.526423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d3d-0698-448d-ad3c-9623d6cc7b87 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:54.526423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf5d3d-0698-448d-ad3c-9623d6cc7b87 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:54.527825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:54.533113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e870676-a376-4165-827d-157e715210a4 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:54.533541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e870676-a376-4165-827d-157e715210a4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:54.534225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e870676-a376-4165-827d-157e715210a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:54.551635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2e870676-a376-4165-827d-157e715210a4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:54.552799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2e870676-a376-4165-827d-157e715210a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:54.560400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:40:54.600293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5d3d-0698-448d-ad3c-9623d6cc7b87 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:54.610929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf5d3d-0698-448d-ad3c-9623d6cc7b87 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:54.614412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e41a5-757f-46fe-b644-0396b2aee02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:54.615043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e41a5-757f-46fe-b644-0396b2aee02e service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:54.615348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e41a5-757f-46fe-b644-0396b2aee02e service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:54.615634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e41a5-757f-46fe-b644-0396b2aee02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:54.624434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e41a5-757f-46fe-b644-0396b2aee02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:54.625860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e41a5-757f-46fe-b644-0396b2aee02e service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:54.635465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 733/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:56.706996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f821-25f6-4522-b26b-8548c180e87f None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:56.707541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f821-25f6-4522-b26b-8548c180e87f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:56.707652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0f821-25f6-4522-b26b-8548c180e87f None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:56.708941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:56.714382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cc74-a657-418f-ab8d-19d8d1bab619 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:56.714828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cc74-a657-418f-ab8d-19d8d1bab619 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:56.714937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111cc74-a657-418f-ab8d-19d8d1bab619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:56.733072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b111cc74-a657-418f-ab8d-19d8d1bab619 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:56.734264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b111cc74-a657-418f-ab8d-19d8d1bab619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:56.741974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:40:56.778800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f821-25f6-4522-b26b-8548c180e87f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:56.790290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0f821-25f6-4522-b26b-8548c180e87f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:56.793814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9471c6-47bf-4cb1-a662-fdf713b8c79e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:56.794450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9471c6-47bf-4cb1-a662-fdf713b8c79e service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:56.794734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9471c6-47bf-4cb1-a662-fdf713b8c79e service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:56.795010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9471c6-47bf-4cb1-a662-fdf713b8c79e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:56.804011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9471c6-47bf-4cb1-a662-fdf713b8c79e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:56.805439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9471c6-47bf-4cb1-a662-fdf713b8c79e service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:56.814831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 724/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:40:58.897243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c841a-d2e2-4954-b390-89abef2497a1 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:58.897743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c841a-d2e2-4954-b390-89abef2497a1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:58.897743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c841a-d2e2-4954-b390-89abef2497a1 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:58.899138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:40:58.904583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f6fd-0256-48c2-85f8-88b5ee5deb62 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:58.905014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f6fd-0256-48c2-85f8-88b5ee5deb62 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:58.905132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9f6fd-0256-48c2-85f8-88b5ee5deb62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:58.922430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-39f9f6fd-0256-48c2-85f8-88b5ee5deb62 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:40:58.923658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-39f9f6fd-0256-48c2-85f8-88b5ee5deb62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:40:58.931893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:40:58.969014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c841a-d2e2-4954-b390-89abef2497a1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:40:58.979634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c841a-d2e2-4954-b390-89abef2497a1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:40:58.983031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe7c4ae-9983-432f-8a34-d4143c1cb09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:40:58.983688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c4ae-9983-432f-8a34-d4143c1cb09d service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:40:58.983972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c4ae-9983-432f-8a34-d4143c1cb09d service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:40:58.984242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe7c4ae-9983-432f-8a34-d4143c1cb09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:40:58.993378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7c4ae-9983-432f-8a34-d4143c1cb09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:40:58.994790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe7c4ae-9983-432f-8a34-d4143c1cb09d service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:40:59.004534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 736/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:01.089676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85e5af-d55a-4689-8f43-41f23af8b303 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:01.090222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85e5af-d55a-4689-8f43-41f23af8b303 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:01.090222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85e5af-d55a-4689-8f43-41f23af8b303 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:01.091644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:01.099450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd188-1203-4294-b7b1-7934726bb8f4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:01.099889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd188-1203-4294-b7b1-7934726bb8f4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:01.100014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bd188-1203-4294-b7b1-7934726bb8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:01.106219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=79 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:41:01.119948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fe9bd188-1203-4294-b7b1-7934726bb8f4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:01.121142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fe9bd188-1203-4294-b7b1-7934726bb8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:01.128896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:01.166973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85e5af-d55a-4689-8f43-41f23af8b303 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:01.172316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=73 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:41:01.178600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85e5af-d55a-4689-8f43-41f23af8b303 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:01.182239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2091c0-5108-4686-ba49-cb0f2f8c7322 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:01.182874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2091c0-5108-4686-ba49-cb0f2f8c7322 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:01.183173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2091c0-5108-4686-ba49-cb0f2f8c7322 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:01.183459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2091c0-5108-4686-ba49-cb0f2f8c7322 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:01.192248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2091c0-5108-4686-ba49-cb0f2f8c7322 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:01.193658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2091c0-5108-4686-ba49-cb0f2f8c7322 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:01.202760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 727/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:03.240818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219af8-937c-43f6-a985-201e35b4b96a None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:03.241359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219af8-937c-43f6-a985-201e35b4b96a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:03.241457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85219af8-937c-43f6-a985-201e35b4b96a None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:03.242773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:03.248047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ef89-cf81-4133-bef8-42867b9468c3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:03.248432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ef89-cf81-4133-bef8-42867b9468c3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:03.248659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ef89-cf81-4133-bef8-42867b9468c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:03.267103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f522ef89-cf81-4133-bef8-42867b9468c3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:03.268928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f522ef89-cf81-4133-bef8-42867b9468c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:03.276490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:03.311467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219af8-937c-43f6-a985-201e35b4b96a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:03.322411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85219af8-937c-43f6-a985-201e35b4b96a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:03.325827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9044b2f-d55c-4721-b644-bc69c3134a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:03.326469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044b2f-d55c-4721-b644-bc69c3134a54 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:03.326738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044b2f-d55c-4721-b644-bc69c3134a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:03.327015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9044b2f-d55c-4721-b644-bc69c3134a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:03.336656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044b2f-d55c-4721-b644-bc69c3134a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:03.338073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9044b2f-d55c-4721-b644-bc69c3134a54 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:03.347344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 739/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:05.355551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b39d6-7218-4a77-aba8-3e6627593c98 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:05.356107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b39d6-7218-4a77-aba8-3e6627593c98 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:05.356107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8b39d6-7218-4a77-aba8-3e6627593c98 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:05.357467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:05.363281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2786de-325c-49be-8c89-8e8b5fb1ca82 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:05.363743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2786de-325c-49be-8c89-8e8b5fb1ca82 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:05.363848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2786de-325c-49be-8c89-8e8b5fb1ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:05.381301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-cf2786de-325c-49be-8c89-8e8b5fb1ca82 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:05.382491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-cf2786de-325c-49be-8c89-8e8b5fb1ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:05.390201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:41:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:05.426298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b39d6-7218-4a77-aba8-3e6627593c98 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:05.436715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8b39d6-7218-4a77-aba8-3e6627593c98 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:05.440178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437da48b-db1e-4e8b-8b0a-3061c9e5516d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:05.440804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da48b-db1e-4e8b-8b0a-3061c9e5516d service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:05.441086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da48b-db1e-4e8b-8b0a-3061c9e5516d service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:05.441358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da48b-db1e-4e8b-8b0a-3061c9e5516d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:05.449889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437da48b-db1e-4e8b-8b0a-3061c9e5516d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:05.451301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437da48b-db1e-4e8b-8b0a-3061c9e5516d service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:05.460577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 730/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:15.376258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=11 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:41:15.456418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=14 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:41:24.883471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed7bb-a1f4-477f-a4b6-9846a8e90c52 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:24.883995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed7bb-a1f4-477f-a4b6-9846a8e90c52 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:24.883995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fed7bb-a1f4-477f-a4b6-9846a8e90c52 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:24.885320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 741/1471] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:24.891040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc824-ec6b-4661-994e-d8524fb0ed52 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:24.891526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc824-ec6b-4661-994e-d8524fb0ed52 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:24.891687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc824-ec6b-4661-994e-d8524fb0ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:24.909543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6d7cc824-ec6b-4661-994e-d8524fb0ed52 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:24.910728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6d7cc824-ec6b-4661-994e-d8524fb0ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:24.918439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 731/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:25.000130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb491-74f4-4daf-a9ff-62b2befabbc7 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:25.000423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb491-74f4-4daf-a9ff-62b2befabbc7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:25.000704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb491-74f4-4daf-a9ff-62b2befabbc7 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:25.002052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 742/1473] 10.222.0.25 () {54 vars in 962 bytes} [Wed Jul 6 13:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:25.007240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4233b2-db33-4f48-94a3-fab9cf4e9f3f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:25.007560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4233b2-db33-4f48-94a3-fab9cf4e9f3f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:25.007830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4233b2-db33-4f48-94a3-fab9cf4e9f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:25.025845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5e4233b2-db33-4f48-94a3-fab9cf4e9f3f None None] MFA Rules not processed for user `e9625fcd053644e3914df6762e067788`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:25.027032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5e4233b2-db33-4f48-94a3-fab9cf4e9f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:25.033367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 732/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Wed Jul 6 13:41:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:25.040501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb491-74f4-4daf-a9ff-62b2befabbc7 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:25.050993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb491-74f4-4daf-a9ff-62b2befabbc7 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:25.054441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4259c-bc3e-4446-b356-a30a7f4eac22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:25.055072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4259c-bc3e-4446-b356-a30a7f4eac22 service glance] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:25.055382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4259c-bc3e-4446-b356-a30a7f4eac22 service glance] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:25.055662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4259c-bc3e-4446-b356-a30a7f4eac22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:25.064401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4259c-bc3e-4446-b356-a30a7f4eac22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:25.066319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4259c-bc3e-4446-b356-a30a7f4eac22 service glance] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:25.075606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 743/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:27.170082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b369df-0f21-4c9a-b1ab-308b350ec09b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:27.170724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b369df-0f21-4c9a-b1ab-308b350ec09b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:27.170724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b369df-0f21-4c9a-b1ab-308b350ec09b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:27.172013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 733/1476] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:27.177652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2343a3-476e-4732-9ceb-cfabcb2b74a9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:27.178105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2343a3-476e-4732-9ceb-cfabcb2b74a9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:27.178215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2343a3-476e-4732-9ceb-cfabcb2b74a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:27.195916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9f2343a3-476e-4732-9ceb-cfabcb2b74a9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:27.197102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9f2343a3-476e-4732-9ceb-cfabcb2b74a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:27.204725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 744/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:27.227996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b369df-0f21-4c9a-b1ab-308b350ec09b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:27.240720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b369df-0f21-4c9a-b1ab-308b350ec09b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:27.245028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:27.245663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:27.245945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:27.246221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:27.246950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:27.248715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:41:27.248715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:41:27.248715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:41:27.249845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09cfa9-d8d1-4e8c-8dae-18d1706d1278 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:27.269019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 734/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Wed Jul 6 13:41:27 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:41:29.296954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e03d8-f7e5-481b-a804-0b588acb8cf2 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:29.297462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e03d8-f7e5-481b-a804-0b588acb8cf2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:29.297462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e03d8-f7e5-481b-a804-0b588acb8cf2 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:29.298828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 745/1479] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:29.304466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1c23-7bf2-41ca-bead-ab1878de73fe None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:29.304891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1c23-7bf2-41ca-bead-ab1878de73fe None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:29.305021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae1c23-7bf2-41ca-bead-ab1878de73fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:29.322690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-feae1c23-7bf2-41ca-bead-ab1878de73fe None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:29.323908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-feae1c23-7bf2-41ca-bead-ab1878de73fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:29.331958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 735/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:29.375018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e03d8-f7e5-481b-a804-0b588acb8cf2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:29.389276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e03d8-f7e5-481b-a804-0b588acb8cf2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:29.394515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83263d7f-30a5-4f8a-87b8-efb7fceca735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:29.395145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263d7f-30a5-4f8a-87b8-efb7fceca735 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:29.395458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263d7f-30a5-4f8a-87b8-efb7fceca735 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:29.395737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83263d7f-30a5-4f8a-87b8-efb7fceca735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:29.403790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83263d7f-30a5-4f8a-87b8-efb7fceca735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:29.405365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83263d7f-30a5-4f8a-87b8-efb7fceca735 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:29.415091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 746/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:31.609199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd965fd-7158-4506-bef7-bbc71e55fb58 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:31.609726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd965fd-7158-4506-bef7-bbc71e55fb58 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:31.609726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd965fd-7158-4506-bef7-bbc71e55fb58 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:31.611102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 736/1482] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:31.616296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6787b-b138-4668-9920-5deebb5a6fa5 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:31.616701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6787b-b138-4668-9920-5deebb5a6fa5 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:31.616899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6787b-b138-4668-9920-5deebb5a6fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:31.634762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-98b6787b-b138-4668-9920-5deebb5a6fa5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:31.635972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-98b6787b-b138-4668-9920-5deebb5a6fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:31.644159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 747/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:31.678584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd965fd-7158-4506-bef7-bbc71e55fb58 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:31.689145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd965fd-7158-4506-bef7-bbc71e55fb58 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:31.693109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0e5df-29f5-47c6-a13f-b084f7742d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:31.693734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0e5df-29f5-47c6-a13f-b084f7742d14 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:31.694013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0e5df-29f5-47c6-a13f-b084f7742d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:31.694285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0e5df-29f5-47c6-a13f-b084f7742d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:31.702914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0e5df-29f5-47c6-a13f-b084f7742d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:31.704367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0e5df-29f5-47c6-a13f-b084f7742d14 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:31.714919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 737/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:33.796559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0d8cd-f97c-47f0-bbd1-4b4228c19428 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:33.797127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0d8cd-f97c-47f0-bbd1-4b4228c19428 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:33.797127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0d8cd-f97c-47f0-bbd1-4b4228c19428 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:33.798478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 748/1485] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:33.804209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f9ad-fe9a-420f-9952-f1b1b82596cb None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:33.804630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f9ad-fe9a-420f-9952-f1b1b82596cb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:33.804767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0f9ad-fe9a-420f-9952-f1b1b82596cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:33.821999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-58c0f9ad-fe9a-420f-9952-f1b1b82596cb None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:33.823180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-58c0f9ad-fe9a-420f-9952-f1b1b82596cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:33.830831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 738/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:33.868723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0d8cd-f97c-47f0-bbd1-4b4228c19428 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:33.879375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0d8cd-f97c-47f0-bbd1-4b4228c19428 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:33.882864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74379b1-aa2b-48bb-af1a-4e56d4196e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:33.883527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74379b1-aa2b-48bb-af1a-4e56d4196e7a service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:33.883817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74379b1-aa2b-48bb-af1a-4e56d4196e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:33.884094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74379b1-aa2b-48bb-af1a-4e56d4196e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:33.892926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74379b1-aa2b-48bb-af1a-4e56d4196e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:33.894385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74379b1-aa2b-48bb-af1a-4e56d4196e7a service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:33.903761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 749/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:36.023701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae535a-04dc-4588-ba48-112823ea26df None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:36.024343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae535a-04dc-4588-ba48-112823ea26df None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:36.024343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae535a-04dc-4588-ba48-112823ea26df None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:36.025553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 739/1488] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:36.031098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd773-e2a7-4bfb-b6d3-2008c08f144f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:36.031550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd773-e2a7-4bfb-b6d3-2008c08f144f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:36.031685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bd773-e2a7-4bfb-b6d3-2008c08f144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:36.048985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-4f8bd773-e2a7-4bfb-b6d3-2008c08f144f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:36.050166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4f8bd773-e2a7-4bfb-b6d3-2008c08f144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:36.058052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 750/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:36.099092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae535a-04dc-4588-ba48-112823ea26df None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:36.109628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae535a-04dc-4588-ba48-112823ea26df None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:36.113137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7d765-355b-4f60-b3c0-010d0639cbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:36.113766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d765-355b-4f60-b3c0-010d0639cbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:36.114051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d765-355b-4f60-b3c0-010d0639cbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:36.114329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7d765-355b-4f60-b3c0-010d0639cbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:36.122997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d765-355b-4f60-b3c0-010d0639cbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:36.124490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7d765-355b-4f60-b3c0-010d0639cbc8 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:36.134138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 740/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:38.321855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80578-a74b-4626-8731-5408519a9326 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:38.322375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80578-a74b-4626-8731-5408519a9326 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:38.322504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e80578-a74b-4626-8731-5408519a9326 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:38.323829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 751/1491] 10.222.0.25 () {54 vars in 926 bytes} [Wed Jul 6 13:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:41:38.329028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d990b-d811-471b-8e5b-fb4d9e4a4af0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:38.329430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d990b-d811-471b-8e5b-fb4d9e4a4af0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:38.329584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d990b-d811-471b-8e5b-fb4d9e4a4af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:38.347819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f29d990b-d811-471b-8e5b-fb4d9e4a4af0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:41:38.349010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f29d990b-d811-471b-8e5b-fb4d9e4a4af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:41:38.356678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 741/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Wed Jul 6 13:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:41:38.394844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80578-a74b-4626-8731-5408519a9326 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:41:38.405590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e80578-a74b-4626-8731-5408519a9326 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:41:38.409607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb21c17-0e75-45b0-aa96-6bdcd24ea60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:41:38.410241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21c17-0e75-45b0-aa96-6bdcd24ea60c service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:41:38.410525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21c17-0e75-45b0-aa96-6bdcd24ea60c service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:41:38.410798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb21c17-0e75-45b0-aa96-6bdcd24ea60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:41:38.419700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21c17-0e75-45b0-aa96-6bdcd24ea60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:41:38.421133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb21c17-0e75-45b0-aa96-6bdcd24ea60c service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:41:38.431121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 752/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:41:48.342384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=33 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:41:48.426971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=33 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:03.572405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.573002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.573002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.591093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:43:03.592294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:03.599869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 742/1494] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:43:03.607777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.608243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.608345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.625713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:43:03.626887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:03.635129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 753/1495] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:43:03.639402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:03.649311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec2ef6-cc6f-4aa0-b008-1ed46e4c5163 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:03.653726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:03.654369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.654651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.654922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.655677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:43:03.655979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:03.656973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:03.656973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:43:03.656973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:43:03.657850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:03.668956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 743/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:43:03.676811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:03.685804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ac687-9de3-43d4-9eda-72e033ec98c8 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:03.690252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:03.691447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.691734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.692012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.692695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:03.694467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:03.694467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:43:03.694467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:43:03.695707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:03.730322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 754/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:43:03 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:43:03.734418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:03.744032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbf7e8-f898-47bb-8f81-f0c56818e52e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:03.797812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:03.798472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.798755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.799030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.799748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:03.801272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:03.801272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:43:03.801272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:43:03.802463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:03.823258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 744/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:43:03 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:43:03.827220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:03.837607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c966f-481c-4cde-b720-31f554e8bd9c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:03.842294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:03.842946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.843231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.843537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.844258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:03.845267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:03.845267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:43:03.845267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:43:03.846143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:03.858717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 755/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:43:03.862460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:03.872611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd09792-845d-47d3-8ae6-6d5fdc424c50 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:03.877191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:03.877956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.878829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.879111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.879880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:03.880881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:03.880881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:43:03.880881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:43:03.881750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd4ab4-c031-4a88-8372-9d9b6f97b9eb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:03.894679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 745/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:43:03.898554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:03.908412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5ad6f-1f26-4d94-ba90-04e374f6b3f7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:03.915218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:03.915218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.915218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.915218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] PATH_INFO: `/v3/projects/dbfadd2815294e29ab90f93d7442ae20/users/c6cdd3469b2c487aa1529a773d902665/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.930617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbfadd2815294e29ab90f93d7442ae20, user_id=c6cdd3469b2c487aa1529a773d902665, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:03.931686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:03.931686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:43:03.931686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:43:03.933604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4aeda6-495d-4281-96b9-f642e0f1bf86 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:03.946677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 756/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:43:03 2022] PUT /identity/v3/projects/dbfadd2815294e29ab90f93d7442ae20/users/c6cdd3469b2c487aa1529a773d902665/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:43:03.958577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebad88-89f5-49a0-b90a-a064d00e451c None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:03.958867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebad88-89f5-49a0-b90a-a064d00e451c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:03.959141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebad88-89f5-49a0-b90a-a064d00e451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:03.984220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1cebad88-89f5-49a0-b90a-a064d00e451c None None] MFA Rules not processed for user `c6cdd3469b2c487aa1529a773d902665`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:43:03.985400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1cebad88-89f5-49a0-b90a-a064d00e451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:04.047631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 746/1502] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:43:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:43:04.061076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861bcf1-7ee9-43d8-9662-8d3f017ca877 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.061396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861bcf1-7ee9-43d8-9662-8d3f017ca877 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.061678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861bcf1-7ee9-43d8-9662-8d3f017ca877 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.063073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 757/1503] 10.222.0.25 () {54 vars in 963 bytes} [Wed Jul 6 13:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:43:04.068799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc0d20-466a-4516-a971-86924b6c2a82 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.069088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc0d20-466a-4516-a971-86924b6c2a82 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.069364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc0d20-466a-4516-a971-86924b6c2a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.086832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-eabc0d20-466a-4516-a971-86924b6c2a82 None None] MFA Rules not processed for user `695790c0f33f40e1a0ea7e70318d419a`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:43:04.087993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-eabc0d20-466a-4516-a971-86924b6c2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:04.129748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:04.138984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 747/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Wed Jul 6 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:43:04.146869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861bcf1-7ee9-43d8-9662-8d3f017ca877 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:04.157464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861bcf1-7ee9-43d8-9662-8d3f017ca877 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:04.160993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:04.161618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.161900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.162176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.170338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:04.171805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:04.181073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 758/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:43:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:43:04.222661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a934-40d8-4c7a-9b48-9433fa4dd8eb None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.222955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a934-40d8-4c7a-9b48-9433fa4dd8eb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.223260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a934-40d8-4c7a-9b48-9433fa4dd8eb None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.224574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 748/1506] 10.222.0.25 () {52 vars in 829 bytes} [Wed Jul 6 13:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:43:04.228135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:04.288926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e1c6-97a7-4906-b250-aae140add049 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:04.293382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:04.294248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.294532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.294809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] PATH_INFO: `/v3/users/c6cdd3469b2c487aa1529a773d902665` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.295989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cdd3469b2c487aa1529a773d902665)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:04.297003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:04.297003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:43:04.297003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:43:04.298221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:04.362039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cdd3469b2c487aa1529a773d902665'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:04.380818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cdd3469b2c487aa1529a773d902665'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:04.394510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cdd3469b2c487aa1529a773d902665'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:04.395302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cdd3469b2c487aa1529a773d902665'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:04.395953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cdd3469b2c487aa1529a773d902665'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:04.399828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:04.411805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 759/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:43:04 2022] DELETE /identity/v3/users/c6cdd3469b2c487aa1529a773d902665 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:43:04.416202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.416519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.416846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.435617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:43:04.436828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:04.493613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 749/1508] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:43:04.503761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:04.505184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:04.567958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf72751-dfe4-47a4-b5df-3c88fd8c6778 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:04.571616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e45166-606d-44e4-8923-f3cae27f3c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:04.572303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45166-606d-44e4-8923-f3cae27f3c71 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.572588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45166-606d-44e4-8923-f3cae27f3c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.572865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e45166-606d-44e4-8923-f3cae27f3c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.582114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e45166-606d-44e4-8923-f3cae27f3c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:04.583567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e45166-606d-44e4-8923-f3cae27f3c71 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:04.592942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 760/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:43:04.930689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:43:04.932373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:43:04.945271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4cda2-30c8-4e3f-b431-41cbfe08af11 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:43:04.950991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:43:04.951887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:43:04.952172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:43:04.952437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] PATH_INFO: `/v3/projects/dbfadd2815294e29ab90f93d7442ae20` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:43:04.953666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbfadd2815294e29ab90f93d7442ae20)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:43:04.955392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:43:04.955392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:43:04.955392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:43:04.957339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:43:05.017744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbfadd2815294e29ab90f93d7442ae20', 'request_id': 'req-36f47112-68cb-4b01-87e6-0abf5cb8df86'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:05.024610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbfadd2815294e29ab90f93d7442ae20', 'request_id': 'req-36f47112-68cb-4b01-87e6-0abf5cb8df86'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:05.037640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbfadd2815294e29ab90f93d7442ae20', 'request_id': 'req-36f47112-68cb-4b01-87e6-0abf5cb8df86'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:05.052370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] The token cache is being invalidate because project dbfadd2815294e29ab90f93d7442ae20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:43:05.052659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:05.053309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-36f47112-68cb-4b01-87e6-0abf5cb8df86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:43:05.054977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 750/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:43:04 2022] DELETE /identity/v3/projects/dbfadd2815294e29ab90f93d7442ae20 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:43:14.588629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:43:15.049188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:44:48.970576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745aa0d-5205-4f5b-8bf6-a267adc3cab6 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:48.971168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745aa0d-5205-4f5b-8bf6-a267adc3cab6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:48.971168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745aa0d-5205-4f5b-8bf6-a267adc3cab6 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:48.972725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:44:48.978493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d170-e7d8-4f65-abf2-72ba5c077e89 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:48.978936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d170-e7d8-4f65-abf2-72ba5c077e89 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:48.979037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941d170-e7d8-4f65-abf2-72ba5c077e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:48.998341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1941d170-e7d8-4f65-abf2-72ba5c077e89 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:44:48.999624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1941d170-e7d8-4f65-abf2-72ba5c077e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:44:49.058943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:44:49.212507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745aa0d-5205-4f5b-8bf6-a267adc3cab6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:44:49.214506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b745aa0d-5205-4f5b-8bf6-a267adc3cab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:44:49.288394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745aa0d-5205-4f5b-8bf6-a267adc3cab6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:44:49.293618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de6b23-1335-4112-9355-f4cea10ebcdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:44:49.294262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6b23-1335-4112-9355-f4cea10ebcdb service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:49.294549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6b23-1335-4112-9355-f4cea10ebcdb service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:49.294828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de6b23-1335-4112-9355-f4cea10ebcdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:49.302941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6b23-1335-4112-9355-f4cea10ebcdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:44:49.304550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de6b23-1335-4112-9355-f4cea10ebcdb service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:44:49.313841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 762/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:44:50.142178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076f4c3-fbb3-4f9a-a20a-516dca658891 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:50.142709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076f4c3-fbb3-4f9a-a20a-516dca658891 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:50.142828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076f4c3-fbb3-4f9a-a20a-516dca658891 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:50.144175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:44:50.148977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb073d9-f7b1-40fb-b6a4-0d135a0f289e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:50.149391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb073d9-f7b1-40fb-b6a4-0d135a0f289e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:50.149542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb073d9-f7b1-40fb-b6a4-0d135a0f289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:50.167278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-0cb073d9-f7b1-40fb-b6a4-0d135a0f289e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:44:50.168587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0cb073d9-f7b1-40fb-b6a4-0d135a0f289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:44:50.176321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:44:50.326395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076f4c3-fbb3-4f9a-a20a-516dca658891 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:44:50.341074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076f4c3-fbb3-4f9a-a20a-516dca658891 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:44:50.346624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48376e5b-bb3c-400e-8d51-a7242e2a25c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:44:50.347227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376e5b-bb3c-400e-8d51-a7242e2a25c3 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:50.347550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376e5b-bb3c-400e-8d51-a7242e2a25c3 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:50.347833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48376e5b-bb3c-400e-8d51-a7242e2a25c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:50.356665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48376e5b-bb3c-400e-8d51-a7242e2a25c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:44:50.358282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48376e5b-bb3c-400e-8d51-a7242e2a25c3 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:44:50.368242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 753/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:44:51.120141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c44e3-53e8-4095-97e5-1e6a9fc0ce71 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:51.120436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c44e3-53e8-4095-97e5-1e6a9fc0ce71 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:51.120724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c44e3-53e8-4095-97e5-1e6a9fc0ce71 None None] PATH_INFO: `/v3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:51.122072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 764/1517] 10.222.0.40 () {54 vars in 925 bytes} [Wed Jul 6 13:44:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:44:51.135570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb7805-50a1-4f55-b89d-182a8a553151 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:44:51.135867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb7805-50a1-4f55-b89d-182a8a553151 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:44:51.136147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb7805-50a1-4f55-b89d-182a8a553151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:44:51.154451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6fdb7805-50a1-4f55-b89d-182a8a553151 None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:44:51.155700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6fdb7805-50a1-4f55-b89d-182a8a553151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:44:51.216326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 754/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 6 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:00.162432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=37 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:00.690885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58434-2418-4b23-b52a-e5b3f777be7e None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:00.691121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58434-2418-4b23-b52a-e5b3f777be7e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:00.691442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e58434-2418-4b23-b52a-e5b3f777be7e None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:00.692864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 765/1519] 10.222.0.25 () {54 vars in 960 bytes} [Wed Jul 6 13:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:45:00.698084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea4d99-eeff-45a9-b4a5-8647527e0d7f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:00.698527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea4d99-eeff-45a9-b4a5-8647527e0d7f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:00.698645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea4d99-eeff-45a9-b4a5-8647527e0d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:00.717336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0aea4d99-eeff-45a9-b4a5-8647527e0d7f None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:00.718531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0aea4d99-eeff-45a9-b4a5-8647527e0d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:00.727628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 755/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Jul 6 13:45:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:00.735158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58434-2418-4b23-b52a-e5b3f777be7e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:00.748819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e58434-2418-4b23-b52a-e5b3f777be7e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:00.753733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db24e832-3cbb-4b94-8a1f-0770fa811344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:00.754382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e832-3cbb-4b94-8a1f-0770fa811344 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:00.754672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e832-3cbb-4b94-8a1f-0770fa811344 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:00.754955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db24e832-3cbb-4b94-8a1f-0770fa811344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:00.764417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24e832-3cbb-4b94-8a1f-0770fa811344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:00.766015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db24e832-3cbb-4b94-8a1f-0770fa811344 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:00.777879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 766/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:01.586091 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118f49-8209-435e-9a63-e4cf57c1170a None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:01.586379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118f49-8209-435e-9a63-e4cf57c1170a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:01.586656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118f49-8209-435e-9a63-e4cf57c1170a None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:01.588069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:45:01.593141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58dfb-498c-4b26-af77-3df397723195 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:01.593625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58dfb-498c-4b26-af77-3df397723195 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:01.593734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a58dfb-498c-4b26-af77-3df397723195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:01.611299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-57a58dfb-498c-4b26-af77-3df397723195 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:01.612448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-57a58dfb-498c-4b26-af77-3df397723195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:01.620114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:01.770324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118f49-8209-435e-9a63-e4cf57c1170a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:01.785693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118f49-8209-435e-9a63-e4cf57c1170a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:01.791179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd8f30-92cd-4484-bb97-8613d75b6249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:01.791858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd8f30-92cd-4484-bb97-8613d75b6249 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:01.792141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd8f30-92cd-4484-bb97-8613d75b6249 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:01.792416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd8f30-92cd-4484-bb97-8613d75b6249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:01.800726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd8f30-92cd-4484-bb97-8613d75b6249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:01.802318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd8f30-92cd-4484-bb97-8613d75b6249 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:01.811878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 757/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:02.630815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68b45-6cb9-49e0-87f0-987a58fbb9e4 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:02.631381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68b45-6cb9-49e0-87f0-987a58fbb9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:02.631512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d68b45-6cb9-49e0-87f0-987a58fbb9e4 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:02.632815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 13:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:45:02.637616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a80a1f-148e-442c-ae45-cc89c4f295e6 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:02.637929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a80a1f-148e-442c-ae45-cc89c4f295e6 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:02.638205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a80a1f-148e-442c-ae45-cc89c4f295e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:02.656251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-44a80a1f-148e-442c-ae45-cc89c4f295e6 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:02.657477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-44a80a1f-148e-442c-ae45-cc89c4f295e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:02.665904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 13:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:02.815832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d68b45-6cb9-49e0-87f0-987a58fbb9e4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:02.830196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d68b45-6cb9-49e0-87f0-987a58fbb9e4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:02.836558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d6bfa-b934-482a-ad1f-0e501780d9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:02.837190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d6bfa-b934-482a-ad1f-0e501780d9dc service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:02.837474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d6bfa-b934-482a-ad1f-0e501780d9dc service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:02.837753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d6bfa-b934-482a-ad1f-0e501780d9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:02.846232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d6bfa-b934-482a-ad1f-0e501780d9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:02.847871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d6bfa-b934-482a-ad1f-0e501780d9dc service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:02.857855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 769/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:06.788018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7844-45dc-4207-8a98-2437c2bd5477 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:06.788538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7844-45dc-4207-8a98-2437c2bd5477 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:06.788643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b7844-45dc-4207-8a98-2437c2bd5477 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:06.790087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:45:06.795170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd71d4-9041-4ade-8aee-c240cfc2d786 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:06.795667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd71d4-9041-4ade-8aee-c240cfc2d786 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:06.795776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd71d4-9041-4ade-8aee-c240cfc2d786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:06.814299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-66cd71d4-9041-4ade-8aee-c240cfc2d786 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:06.815537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-66cd71d4-9041-4ade-8aee-c240cfc2d786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:06.823348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:06.898218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7844-45dc-4207-8a98-2437c2bd5477 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:06.899946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-896b7844-45dc-4207-8a98-2437c2bd5477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:06.955751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b7844-45dc-4207-8a98-2437c2bd5477 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:06.959225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359eb51-b460-4d68-9d3f-4990839c04da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:06.959894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359eb51-b460-4d68-9d3f-4990839c04da service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:06.960177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359eb51-b460-4d68-9d3f-4990839c04da service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:06.960452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359eb51-b460-4d68-9d3f-4990839c04da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:06.969321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359eb51-b460-4d68-9d3f-4990839c04da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:06.970723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359eb51-b460-4d68-9d3f-4990839c04da service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:06.976017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:06.981160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 760/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:08.978569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2821-f2cb-4864-8d93-1f2a7eee3919 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:08.979135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2821-f2cb-4864-8d93-1f2a7eee3919 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:08.979135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b2821-f2cb-4864-8d93-1f2a7eee3919 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:08.980556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:45:08.985618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889726-89c1-4c6a-9442-0d470bbf93cd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:08.986055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889726-89c1-4c6a-9442-0d470bbf93cd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:08.986165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889726-89c1-4c6a-9442-0d470bbf93cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:09.005917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-55889726-89c1-4c6a-9442-0d470bbf93cd None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:09.007115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-55889726-89c1-4c6a-9442-0d470bbf93cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:09.014913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:09.050696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2821-f2cb-4864-8d93-1f2a7eee3919 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:09.052416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-100b2821-f2cb-4864-8d93-1f2a7eee3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:09.065256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b2821-f2cb-4864-8d93-1f2a7eee3919 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:09.069216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4b5b9-3c00-4251-9517-b8de4305b5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:09.069844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b5b9-3c00-4251-9517-b8de4305b5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:09.070127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b5b9-3c00-4251-9517-b8de4305b5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:09.070425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4b5b9-3c00-4251-9517-b8de4305b5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:09.079218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b5b9-3c00-4251-9517-b8de4305b5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:09.080665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4b5b9-3c00-4251-9517-b8de4305b5e1 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:09.090750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 772/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:12.552370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9322-bdf2-47c5-89a2-2dbc06688f6c None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:12.552964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9322-bdf2-47c5-89a2-2dbc06688f6c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:12.552964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9322-bdf2-47c5-89a2-2dbc06688f6c None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:12.554357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:45:12.559552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942be8-3e16-453e-b8ac-99355e00c16e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:12.559951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942be8-3e16-453e-b8ac-99355e00c16e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:12.560151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8942be8-3e16-453e-b8ac-99355e00c16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:12.578417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e8942be8-3e16-453e-b8ac-99355e00c16e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:12.579641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e8942be8-3e16-453e-b8ac-99355e00c16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:12.587357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:12.889223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9322-bdf2-47c5-89a2-2dbc06688f6c None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:12.890899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-772b9322-bdf2-47c5-89a2-2dbc06688f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:13.068083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b9322-bdf2-47c5-89a2-2dbc06688f6c None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:13.071675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece10f53-4436-486e-b80e-f33eb9b2d343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:13.072316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10f53-4436-486e-b80e-f33eb9b2d343 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:13.072596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10f53-4436-486e-b80e-f33eb9b2d343 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:13.072868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece10f53-4436-486e-b80e-f33eb9b2d343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:13.081718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10f53-4436-486e-b80e-f33eb9b2d343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:13.083698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece10f53-4436-486e-b80e-f33eb9b2d343 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:13.093379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 763/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:15.153555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ac6d-541d-4dd0-ab35-1d17af5de722 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:15.154114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ac6d-541d-4dd0-ab35-1d17af5de722 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:15.154114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2ac6d-541d-4dd0-ab35-1d17af5de722 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:15.155538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 13:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:45:15.160589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da627d-6139-4520-a7ce-d34d6aead501 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:15.161026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da627d-6139-4520-a7ce-d34d6aead501 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:15.161188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da627d-6139-4520-a7ce-d34d6aead501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:15.178594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e6da627d-6139-4520-a7ce-d34d6aead501 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:45:15.179830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e6da627d-6139-4520-a7ce-d34d6aead501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:15.187523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 13:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:45:15.487396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2ac6d-541d-4dd0-ab35-1d17af5de722 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:45:15.489116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-18b2ac6d-541d-4dd0-ab35-1d17af5de722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:45:15.502541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2ac6d-541d-4dd0-ab35-1d17af5de722 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:45:15.506720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa86460-3262-49a4-9fe1-0dba73a04070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:45:15.507384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa86460-3262-49a4-9fe1-0dba73a04070 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:45:15.507675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa86460-3262-49a4-9fe1-0dba73a04070 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:45:15.507955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa86460-3262-49a4-9fe1-0dba73a04070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:45:15.516707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa86460-3262-49a4-9fe1-0dba73a04070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:45:15.518136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa86460-3262-49a4-9fe1-0dba73a04070 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:45:15.528744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 775/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:45:25.173732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=32 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:45:25.524573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=33 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:54.234175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.235254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.235811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.261694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.263393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.275237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 765/1540] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:46:54.284691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc0cd-1724-4cc4-8021-520659641661 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.285282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc0cd-1724-4cc4-8021-520659641661 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.285282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfcc0cd-1724-4cc4-8021-520659641661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.312645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9dfcc0cd-1724-4cc4-8021-520659641661 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.313875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9dfcc0cd-1724-4cc4-8021-520659641661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.328884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 776/1541] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:54.334331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:54.339767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1866-1d3c-4f62-bd8f-a33a7358c7ff None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.340178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1866-1d3c-4f62-bd8f-a33a7358c7ff None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.340440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d1866-1d3c-4f62-bd8f-a33a7358c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.350481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06a547-6135-4896-8aa7-688c141a171d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:54.360858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:54.362240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.362756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.363902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.364883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:54.372193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:54.374522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:54.380508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-115d1866-1d3c-4f62-bd8f-a33a7358c7ff None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.381905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-115d1866-1d3c-4f62-bd8f-a33a7358c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.389453 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 766/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:54.398875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:54.400721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 777/1543] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 06 13:46:54.409409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.410301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.410508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.412212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b8aca-5380-4987-a537-eced67a59d98 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:54.428890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:54.430066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.430759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.431271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.432338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:54.434084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:46:54.434084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:46:54.434084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:46:54.439018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:54.452628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.453848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.476774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 778/1544] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:46:54.481192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:54.487816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 767/1545] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/projects => generated 389 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:46:54.494107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:54.500340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ab494a-e8df-4018-a7d8-2d48be507ba9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:54.598219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999629e0-4a60-4d48-907c-e954efab779a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:54.608264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f6cd1-51d5-4776-83de-c802bfec327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:54.610786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6cd1-51d5-4776-83de-c802bfec327a admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.611300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6cd1-51d5-4776-83de-c802bfec327a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.612484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f6cd1-51d5-4776-83de-c802bfec327a admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.613935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f6cd1-51d5-4776-83de-c802bfec327a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:54.621286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f6cd1-51d5-4776-83de-c802bfec327a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:54.641440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:54.642113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.642395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.642673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.643423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:54.643735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:54.649507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:46:54.649507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:46:54.649507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:46:54.650435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b312-fcc4-401c-9f82-f922abd8943c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:54.675019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 768/1546] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:46:54.677275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.677569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.677846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.678628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 779/1547] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:46:54.683055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.683369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.683655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.724508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.725861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.727671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.728840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.740495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 769/1548] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:54.743100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:54.746827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 780/1549] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:54.755011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:54.768124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905dc88a-96db-4510-85c2-49a07b3c323a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:54.779153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326f664-ef0d-4528-8f96-99c997414127 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:54.794570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6fa4-5afc-4438-a85c-099cf11c317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:54.795251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6fa4-5afc-4438-a85c-099cf11c317e admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.796416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6fa4-5afc-4438-a85c-099cf11c317e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.796696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6fa4-5afc-4438-a85c-099cf11c317e admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.797400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc6fa4-5afc-4438-a85c-099cf11c317e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:54.800047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bc6fa4-5afc-4438-a85c-099cf11c317e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:54.809337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e269d-3c9d-402a-b6c9-d48809ae3e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:54.810059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e269d-3c9d-402a-b6c9-d48809ae3e0b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.810343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e269d-3c9d-402a-b6c9-d48809ae3e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.810622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e269d-3c9d-402a-b6c9-d48809ae3e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.814453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e269d-3c9d-402a-b6c9-d48809ae3e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:54.816788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e269d-3c9d-402a-b6c9-d48809ae3e0b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:54.832946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 781/1550] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:54.835532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b06b3-be09-4cbd-bd4b-a11c6189645a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.836411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b06b3-be09-4cbd-bd4b-a11c6189645a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.836938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b06b3-be09-4cbd-bd4b-a11c6189645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.853091 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 770/1551] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:54.856381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50f7fa-bf62-42a6-be24-9668133d53df None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.856381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50f7fa-bf62-42a6-be24-9668133d53df None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.856381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50f7fa-bf62-42a6-be24-9668133d53df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.859163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a37b06b3-be09-4cbd-bd4b-a11c6189645a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.860460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a37b06b3-be09-4cbd-bd4b-a11c6189645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.876615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5e50f7fa-bf62-42a6-be24-9668133d53df None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.878404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5e50f7fa-bf62-42a6-be24-9668133d53df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.942759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 782/1552] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:54.944128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849b4f-aa1f-449a-99df-12653e88f828 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.944473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849b4f-aa1f-449a-99df-12653e88f828 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.944758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed849b4f-aa1f-449a-99df-12653e88f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.958875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 771/1553] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:54.964002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.964518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.965299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.966665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ed849b4f-aa1f-449a-99df-12653e88f828 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.967900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ed849b4f-aa1f-449a-99df-12653e88f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:54.983473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 783/1554] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:54.983473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:54.983473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:54.983473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:54.985767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:54.987641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.004257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 772/1555] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.004257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.005849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.007039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.013926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd473ac6-caa6-441c-89e2-381c51924680 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.015698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 784/1556] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.016484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.025613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.026672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.026890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.027159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.027921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.032680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a61f6-9143-48f9-8afa-7791ae8b0314 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.032830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.035457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.036788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.037181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.037535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.038336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.039445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:46:55.039445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:46:55.039445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:46:55.040785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.042636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 773/1557] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:55.042636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.047460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:55.054435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273061f0-bd4d-4005-a419-b4968a630e55 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.060016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.060667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.060945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.061220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.061938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:55.062243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.063854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60be159-771f-4695-9d1d-41259f1f94e3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.069225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 785/1558] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/users => generated 286 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.069225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.076913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 774/1559] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:55.078332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f068a-3a79-4ee8-b3f4-b3df13d02659 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.078627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f068a-3a79-4ee8-b3f4-b3df13d02659 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.078907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f068a-3a79-4ee8-b3f4-b3df13d02659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.079036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29fccc-a9de-4837-987b-82e8139e0851 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.084157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.084874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.085167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.085448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.086292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:55.086610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.088275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a89e3-ba35-4829-b5d4-1dd8641ca28f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.096759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7d2f068a-3a79-4ee8-b3f4-b3df13d02659 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.098472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7d2f068a-3a79-4ee8-b3f4-b3df13d02659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.101429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 786/1560] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:55.102683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0735-762a-46ca-a9b2-e5f93fc830d1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.102969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0735-762a-46ca-a9b2-e5f93fc830d1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.103247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f0735-762a-46ca-a9b2-e5f93fc830d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.111821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 775/1561] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.113831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.114219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.114598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.123509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-cb5f0735-762a-46ca-a9b2-e5f93fc830d1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.124698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-cb5f0735-762a-46ca-a9b2-e5f93fc830d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.132824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 787/1562] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.133609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.134241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.134538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.134795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.134977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.142713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 776/1563] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.147255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:55.147436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.153365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.154945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.157445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad145db-c4fe-4f9a-a5dc-615c234d765e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.162407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.163278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.163595 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.163873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] PATH_INFO: `/v3/projects/5f2799c8ae91495dbb779ae2305adcc4/users/2d912686df5d42a58f7369bd5d2b9d25/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.170438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 788/1564] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.171278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.178984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2799c8ae91495dbb779ae2305adcc4, user_id=2d912686df5d42a58f7369bd5d2b9d25, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.180057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:46:55.180057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:46:55.180057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:46:55.181241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94607557-b3fa-45b0-b92d-0811e38da0aa None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.181974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.185721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.186377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.186681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.186944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.187706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.189284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.194996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 777/1565] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:55 2022] PUT /identity/v3/projects/5f2799c8ae91495dbb779ae2305adcc4/users/2d912686df5d42a58f7369bd5d2b9d25/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:55.195942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.199277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 789/1566] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:55.200075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.209460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5fe07-1343-4afc-899c-224e65187c25 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.261192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ab77e-0c28-4268-b3b5-c304a09a91ce admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.265347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.265576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.266010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.266251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.266355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.266534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.266634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.266806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.267236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.267549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.269216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.269593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.294484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 778/1567] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.295139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.298563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 790/1568] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.298563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.356919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78916781-20d8-4b21-a8b1-e330499fb68b admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.359247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf4761-c222-4d9a-8db6-f2795f2863ca admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.361642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.362304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.362588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.362885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.364317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:55.364484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.364627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.365142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.365428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.365706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.366233 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.366423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:55.366731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.368386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6306234e-e9ec-4683-b94b-61e097a80fc9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.377917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 779/1569] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:55.378748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.386768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 791/1570] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:55.386768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bfae-f6bf-4bd9-b64f-e1fa9a3dcd2e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.386768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bfae-f6bf-4bd9-b64f-e1fa9a3dcd2e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.386768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42bfae-f6bf-4bd9-b64f-e1fa9a3dcd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.394491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85662133-2f33-45ac-938e-f791c55089d2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.399196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.399932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.400218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.400503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.401257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:55.401482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7b42bfae-f6bf-4bd9-b64f-e1fa9a3dcd2e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.401586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.402697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7b42bfae-f6bf-4bd9-b64f-e1fa9a3dcd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.403177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.411297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 792/1571] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.412539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.412831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.413114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.416777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 780/1572] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:55.417923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.430890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:55.432116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:55.433387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14f12f-5747-44aa-abec-95ee04a07033 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.438165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.438843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.439123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.439434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.439664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 793/1573] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:55.440208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.440400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.441785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.449517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7204e7-43ed-43a0-bf5b-88de53dc2a55 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.453467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 781/1574] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:55.454199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.454320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.454931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.455176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.455487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.456314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.458586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.464001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4444f7-9a2a-4ca3-a3b6-5cc0db43f1ca admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.468786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.469461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.469741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.470088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.470961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.474246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.480109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 794/1575] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.480893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.484285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:55.492984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3399c-e0e9-437f-84a8-5d78352dd3d4 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.496090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 782/1576] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.496878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.499524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.500154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.500435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.500711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.501390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.503274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.509345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e766d-f0c8-4096-8c52-0833c699d637 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.516588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.516947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.517169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.517455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.518162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.521610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.532720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 795/1577] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.532720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.549434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:55.549940 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 783/1578] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.550858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.595572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229fff56-fa44-4fe1-8be2-0dafdfd775bb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.611772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde5b03-efcd-4af6-957e-1daf9e187379 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.616409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.617067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.617348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.617621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.618296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.620252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.646072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 784/1579] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.646982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.654053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.654357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.654643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.654923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.655743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:46:55.656068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.657638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.670322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 796/1580] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:46:55.671112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.680601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25dc44-080a-417a-8369-1c5837d250a8 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.711258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0d8cb-70b6-4e23-9a3f-b5fae15a56cd admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.715149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.715854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.716137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.716413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.737256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.738169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.738451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.738845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] PATH_INFO: `/v3/projects/50f73d4811f04b37bb1b4653a1578f3d/users/915a9e7b337643f8a2b7a0ff1cc1df33/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.752782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50f73d4811f04b37bb1b4653a1578f3d, user_id=915a9e7b337643f8a2b7a0ff1cc1df33, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.755531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.769034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 797/1581] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:55 2022] PUT /identity/v3/projects/50f73d4811f04b37bb1b4653a1578f3d/users/915a9e7b337643f8a2b7a0ff1cc1df33/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:55.770460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.783869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.785922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.796942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 785/1582] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:55.798337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.805337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:55.811891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a866f2-edad-42f7-84b2-34f617e8e7d9 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.838282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:55.861090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67564-389d-4b0a-856c-577856458221 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.866123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.866881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.867557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.867674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.868371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.870119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.881554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 798/1583] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:55.881684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.882305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.882594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.882869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.883670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.884313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.885372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.895974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d7835-65d2-4ad0-b017-db4ed5b1d0d4 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.900601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 786/1584] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:55.901454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.902813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.903517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.903822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.904276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.904797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.906767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.912788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93336bf2-011a-414c-ad8a-08474d4b5ef1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.920029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.920888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.921349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.921634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.922799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.925102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.928180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 799/1585] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.928816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.942363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78f4bb8-661b-42bd-9c44-bf23f6a1e129 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.947905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bed05-2109-48da-8770-0183ef854011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.948636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bed05-2109-48da-8770-0183ef854011 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.948927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bed05-2109-48da-8770-0183ef854011 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.949358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bed05-2109-48da-8770-0183ef854011 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.950056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bed05-2109-48da-8770-0183ef854011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.950959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 787/1586] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/users => generated 284 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.951658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:55.952258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bed05-2109-48da-8770-0183ef854011 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.961972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e57f4-9617-4d06-b7e6-25f90fd51c8a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:55.967914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:55.968656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.969009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.969621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:55.970892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:55.973300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:55.976273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 800/1587] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/users => generated 302 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:55.977691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:55.978106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:55.978496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.011650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 788/1588] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:56.011650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.012176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] MFA Rules not processed for user `915a9e7b337643f8a2b7a0ff1cc1df33`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:56.012176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:56.090372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3160d3-9d64-4620-b388-ea730f669995 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.095989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.096676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.096962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.097754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.098590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.099467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 801/1589] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:56.100257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.100959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.111213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 789/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.112223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.116383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fc342-2605-4d33-8bd5-494922155ef5 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.122891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.123659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.124041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.124159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083fa9f-96dd-4008-9f4c-e5697deea545 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.124899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.126179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.128876 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.130319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.131054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.131383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.131851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.132609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.134385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.147018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 802/1591] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.148203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.155761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 790/1592] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.156784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.163067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4cb01-4011-4d7d-bf2d-e300da39c5c7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.170973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dca65d-7cbf-4d11-9e38-398247deb884 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.172039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.174269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.174922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.175022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.177021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.178646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.184745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.185698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.186169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.186652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.187583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.189860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.193369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 803/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.193369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.201595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa04c8-2fc7-4531-a87c-1774513e4848 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.207968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 791/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.208715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6ed09-7f96-4252-9b1e-1218c2c09119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.209393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ed09-7f96-4252-9b1e-1218c2c09119 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.209728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.209837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ed09-7f96-4252-9b1e-1218c2c09119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.210090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6ed09-7f96-4252-9b1e-1218c2c09119 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.211040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ed09-7f96-4252-9b1e-1218c2c09119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.213231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6ed09-7f96-4252-9b1e-1218c2c09119 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.222296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aafcb-1730-4eab-82b1-699134cb6fc0 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.228550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.229850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.230270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.230876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] PATH_INFO: `/v3/projects/804dae743e8f451893b6c87ba2166444/users/8294e8eb82634a869a69d0bc71a23b14/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.248925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 804/1595] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:56 2022] POST /identity/v3/users => generated 287 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:56.248925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef61a7-c2ef-45f8-934d-bccfefb630cd None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.249222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef61a7-c2ef-45f8-934d-bccfefb630cd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.249485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef61a7-c2ef-45f8-934d-bccfefb630cd None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.249991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=804dae743e8f451893b6c87ba2166444, user_id=8294e8eb82634a869a69d0bc71a23b14, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.251940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 805/1596] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 13:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:46:56.252686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef61a7-c2ef-45f8-934d-bccfefb630cd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.253676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.267349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef61a7-c2ef-45f8-934d-bccfefb630cd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.270821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 792/1597] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:56 2022] PUT /identity/v3/projects/804dae743e8f451893b6c87ba2166444/users/8294e8eb82634a869a69d0bc71a23b14/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:56.271571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.281357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:56.323465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:56.336906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.337812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.338103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.338388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] PATH_INFO: `/v3/projects/1395db83c6574b6188bcafaca8b5fcd7/users/29bed120fba74e638d9e9fe1f6d37d46/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.345945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28cf25-1f59-4f4f-8628-bead70ab10e3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.352315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.353407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.353692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.353971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.354793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.356362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.357105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1395db83c6574b6188bcafaca8b5fcd7, user_id=29bed120fba74e638d9e9fe1f6d37d46, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.359942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.367431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 793/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.368272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.379117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ebfee8-f312-4183-81f7-a36366586b84 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.379555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 806/1599] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:56 2022] PUT /identity/v3/projects/1395db83c6574b6188bcafaca8b5fcd7/users/29bed120fba74e638d9e9fe1f6d37d46/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:56.380578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.441751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.442450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.442732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.443108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.443754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.445374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.448192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8777f-3af8-4870-92b5-aa395c2ede17 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.453351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f00a8-96f8-4f69-9333-04dba941d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.454253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f00a8-96f8-4f69-9333-04dba941d977 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.454834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f00a8-96f8-4f69-9333-04dba941d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.455170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f00a8-96f8-4f69-9333-04dba941d977 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.455946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 794/1600] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.456228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f00a8-96f8-4f69-9333-04dba941d977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.457602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.458556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f00a8-96f8-4f69-9333-04dba941d977 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.469122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ae544-b17f-46c6-8686-1d8c56207a83 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.473271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 807/1601] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.474651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.474944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.475228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.476274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c8a23-eb6b-4c63-90a8-375c5873dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.476937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c8a23-eb6b-4c63-90a8-375c5873dc9f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.477218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c8a23-eb6b-4c63-90a8-375c5873dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.477680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c8a23-eb6b-4c63-90a8-375c5873dc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.478408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c8a23-eb6b-4c63-90a8-375c5873dc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.480223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c8a23-eb6b-4c63-90a8-375c5873dc9f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.490791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 795/1602] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.492242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174597c-0a2a-4482-b39e-c5c2b1fa2db6 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.492540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174597c-0a2a-4482-b39e-c5c2b1fa2db6 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.492821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174597c-0a2a-4482-b39e-c5c2b1fa2db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.496300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:56.497606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:56.520580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d174597c-0a2a-4482-b39e-c5c2b1fa2db6 None None] MFA Rules not processed for user `8294e8eb82634a869a69d0bc71a23b14`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:56.524186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d174597c-0a2a-4482-b39e-c5c2b1fa2db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:56.584465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 808/1603] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:56.585442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.602848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 796/1604] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:56.604422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.604860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.605403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.608191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9529201a-28aa-453d-9668-90c9c8731e91 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.616451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.618580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.618962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.619704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] PATH_INFO: `/v3/projects/897f95d4ba0b470f844c37f07d6bfee2/users/0d6f85dc30f54c2eb9f6c78a1c93fe5f/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.643295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] RBAC: Authorizing `identity:create_grant(project_id=897f95d4ba0b470f844c37f07d6bfee2, user_id=0d6f85dc30f54c2eb9f6c78a1c93fe5f, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.647455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.647610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:56.651769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:56.663216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 797/1605] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:56.664303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.670148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 809/1606] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:56 2022] PUT /identity/v3/projects/897f95d4ba0b470f844c37f07d6bfee2/users/0d6f85dc30f54c2eb9f6c78a1c93fe5f/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:56.671812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.675426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411e44-7914-46ab-9e0c-54e650a4a3da None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.685059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:56.745401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:56.750861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.752284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.752849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.753134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] PATH_INFO: `/v3/projects/55f9c839d7aa4ce199b8ccd1de3a3c04/users/5d27e24b081548058e0c6c4fcf579a16/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.776169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51dfcd-d57c-4924-b916-506666d2830f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.776733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55f9c839d7aa4ce199b8ccd1de3a3c04, user_id=5d27e24b081548058e0c6c4fcf579a16, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.780641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.782201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.783356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.783856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.784965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] PATH_INFO: `/v3/projects/9f862e095814417081524fd8773394a2/users/5e17c579fd154e079c6070735d3c10b8/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.809193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f862e095814417081524fd8773394a2, user_id=5e17c579fd154e079c6070735d3c10b8, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.811447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 798/1607] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:56 2022] PUT /identity/v3/projects/55f9c839d7aa4ce199b8ccd1de3a3c04/users/5d27e24b081548058e0c6c4fcf579a16/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:56.813726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.823967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.832942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 810/1608] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:56 2022] PUT /identity/v3/projects/9f862e095814417081524fd8773394a2/users/5e17c579fd154e079c6070735d3c10b8/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:56.837568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:56.908098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b8d7a-2e04-4827-b83d-677a978788c6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.922871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead7fae-ecca-47ce-8a89-4ba5a81b2969 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:56.929315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.930333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.930585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.930978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.978367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03255946-4242-4636-91f8-18f73b3a7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:56.979163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03255946-4242-4636-91f8-18f73b3a7dab admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.979483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03255946-4242-4636-91f8-18f73b3a7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.979893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03255946-4242-4636-91f8-18f73b3a7dab admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:56.980643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03255946-4242-4636-91f8-18f73b3a7dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:56.982251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03255946-4242-4636-91f8-18f73b3a7dab admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:56.994271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 799/1609] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:56.998994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d6a2-668e-4bb9-8bc7-49769820526e None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:56.999289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d6a2-668e-4bb9-8bc7-49769820526e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:56.999599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a1d6a2-668e-4bb9-8bc7-49769820526e None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.006275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 800/1610] 10.222.0.25 () {54 vars in 961 bytes} [Wed Jul 6 13:46:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:46:57.007821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e578-09f2-47a0-b6fb-491692af788b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.008121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e578-09f2-47a0-b6fb-491692af788b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.008402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7e578-09f2-47a0-b6fb-491692af788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.020764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.024083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.027869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e2b7e578-09f2-47a0-b6fb-491692af788b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:57.029202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e2b7e578-09f2-47a0-b6fb-491692af788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:57.037305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 811/1611] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:57.037919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 801/1612] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:57.038994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:57.039356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.039738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.040022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.072135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] MFA Rules not processed for user `5d27e24b081548058e0c6c4fcf579a16`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:57.073549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:57.101261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:57.128387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccde32a-a3a7-4a66-86f9-4eb708c050aa service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:57.132705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff901-4b3f-45c8-9469-2ba83d10dafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:57.133833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff901-4b3f-45c8-9469-2ba83d10dafd service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.134125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff901-4b3f-45c8-9469-2ba83d10dafd service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.134619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff901-4b3f-45c8-9469-2ba83d10dafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.148273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff901-4b3f-45c8-9469-2ba83d10dafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.150030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff901-4b3f-45c8-9469-2ba83d10dafd service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.156130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:57.163776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 812/1613] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:57.165954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b59117-898e-4833-9395-a7485e68c8ad None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.166309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b59117-898e-4833-9395-a7485e68c8ad None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.166591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b59117-898e-4833-9395-a7485e68c8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.183850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 802/1614] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:57.186962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-02b59117-898e-4833-9395-a7485e68c8ad None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:57.188315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-02b59117-898e-4833-9395-a7485e68c8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:57.188721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:57.200367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 813/1615] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:57.200367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.200367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.200367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.213546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e424-0076-4454-9753-2703a5723adf None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:57.220578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:57.221926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:57.228549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:57.230209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.230599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.230976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] PATH_INFO: `/v3/projects/0c24d840f593412da4c63d7c2fdc13ff/users/e600ce105a1a4c9bb5c914cb2a8e8f0d/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.232770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 814/1616] 10.222.0.25 () {58 vars in 1058 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:57.233641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:57.243745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db6c7-b05d-41b8-a11b-8826db8990e3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:57.249028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:57.249862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.250222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.250596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.270177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.270177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.270512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c24d840f593412da4c63d7c2fdc13ff, user_id=e600ce105a1a4c9bb5c914cb2a8e8f0d, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.274511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.277056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 815/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:57.278083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:57.328505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 803/1618] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:57 2022] PUT /identity/v3/projects/0c24d840f593412da4c63d7c2fdc13ff/users/e600ce105a1a4c9bb5c914cb2a8e8f0d/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:57.329373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:57.346715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201bf10-8127-4096-9670-4fb52f6e35e5 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:57.409218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:57.410445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.410727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.411056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.480335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d6d42-3bf5-4d95-871a-1143ee25d84d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:57.486716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.488954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.493704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f423d-b713-4e08-b08a-c8fe43753d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:57.496614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f423d-b713-4e08-b08a-c8fe43753d42 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.497022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f423d-b713-4e08-b08a-c8fe43753d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.497169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f423d-b713-4e08-b08a-c8fe43753d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.500966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 816/1619] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:57.501906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:57.603254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:57.663165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175c282-c31c-46cd-8337-1dacc863a2c7 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:57.678336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f423d-b713-4e08-b08a-c8fe43753d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.679589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfa9db-4bc0-4c02-ab15-3ca1120846d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:57.680019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f423d-b713-4e08-b08a-c8fe43753d42 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.681074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfa9db-4bc0-4c02-ab15-3ca1120846d2 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.682313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfa9db-4bc0-4c02-ab15-3ca1120846d2 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.682887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfa9db-4bc0-4c02-ab15-3ca1120846d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.701681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 804/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:57.703152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.703480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.703770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.774448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] MFA Rules not processed for user `e600ce105a1a4c9bb5c914cb2a8e8f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:57.776103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:57.843092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfa9db-4bc0-4c02-ab15-3ca1120846d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:57.848134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfa9db-4bc0-4c02-ab15-3ca1120846d2 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:57.878436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 817/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:57.880161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6cc5-2ce4-4829-9a98-e7444764cb11 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.880605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6cc5-2ce4-4829-9a98-e7444764cb11 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.880898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a6cc5-2ce4-4829-9a98-e7444764cb11 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.886637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 818/1622] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 13:46:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:46:57.893109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:57.907979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:57.912885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:57.914094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:57.985641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 805/1623] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:57.990949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:58.002764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:58.013031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:58.016643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a759a4-1763-420a-98a3-fe738bb4af42 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:58.028138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:58.029019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.029325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.029649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.030429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:58.033958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:58.063563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 819/1624] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:58.080379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:58.107342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 806/1625] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:57 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:46:58.108566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:58.111499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce97bc-b04e-4bd4-ae09-0421ebea8526 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:58.306459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:58.308018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.309804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.310205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.371400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beed85a-742b-41c4-adb3-c127aad5c299 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:58.387242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:58.388398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.389014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.389677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.391175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:58.393757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:58.463877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 807/1626] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:46:58 2022] POST /identity/v3/users => generated 292 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:46:58.466389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:58.472952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:58.476673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:58.491784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852ecfd-1c4a-4ff5-9711-a455279c74f1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:58.505356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 820/1627] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:46:58.505744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77da1d9-75fd-4c79-a84a-23d3b04b4514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:58.506757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77da1d9-75fd-4c79-a84a-23d3b04b4514 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.507076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77da1d9-75fd-4c79-a84a-23d3b04b4514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.509393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77da1d9-75fd-4c79-a84a-23d3b04b4514 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.510193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77da1d9-75fd-4c79-a84a-23d3b04b4514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:58.517264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77da1d9-75fd-4c79-a84a-23d3b04b4514 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:58.560513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 808/1628] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:58.562258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:58.581207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791bf31-c675-4c90-a4e4-4875ae4e69d6 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:58.596294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:58.599668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.600483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.602563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] PATH_INFO: `/v3/projects/ced57e31b58b485e844a28a629d39d5e/users/c96903ee48994b2e8df029261dd95b6e/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.649772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:58.658640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced57e31b58b485e844a28a629d39d5e, user_id=c96903ee48994b2e8df029261dd95b6e, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:58.667037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:58.704040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc45a8-3f8c-4d97-95b6-fd4cb099c2a2 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.704487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc45a8-3f8c-4d97-95b6-fd4cb099c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.705460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc45a8-3f8c-4d97-95b6-fd4cb099c2a2 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.707982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 809/1629] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 13:46:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:46:58.716054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 821/1630] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:58 2022] PUT /identity/v3/projects/ced57e31b58b485e844a28a629d39d5e/users/c96903ee48994b2e8df029261dd95b6e/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:46:58.719185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.719710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.720029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.720820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:58.834096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:58.848714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:58.926601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fc692-02bb-4ba1-9a25-5e6016f6e853 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:58.940384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:58.941257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:58.944413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:58.945198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:58.946148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:58.947989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:58.982942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 822/1631] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:46:58.984271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:59.022869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86364988-120d-4b62-a031-e9f9fc050c02 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:59.039523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a7396-2673-495d-a602-e711be9b6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:59.040670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a7396-2673-495d-a602-e711be9b6ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:59.042127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a7396-2673-495d-a602-e711be9b6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:59.043197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a7396-2673-495d-a602-e711be9b6ce3 admin admin] PATH_INFO: `/v3/projects/ced57e31b58b485e844a28a629d39d5e/users/c96903ee48994b2e8df029261dd95b6e/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:59.048968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a7396-2673-495d-a602-e711be9b6ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced57e31b58b485e844a28a629d39d5e, user_id=c96903ee48994b2e8df029261dd95b6e, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:59.055267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a7396-2673-495d-a602-e711be9b6ce3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:59.063234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 810/1632] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:46:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:59.082581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:59.100970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 823/1633] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:46:58 2022] PUT /identity/v3/projects/ced57e31b58b485e844a28a629d39d5e/users/c96903ee48994b2e8df029261dd95b6e/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:46:59.102809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:59.103185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:59.103556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:59.157359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] MFA Rules not processed for user `c96903ee48994b2e8df029261dd95b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:59.158974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:59.160457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:59.236818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9700b972-07f2-4c94-9e32-0c936764bfc9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:59.324815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 824/1634] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:59.349738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:59.350422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:59.350704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:59.350978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:59.427510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:46:59.447252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea498c-9b57-494e-bcfb-2db904172d88 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:46:59.460952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932bab9-6fd3-4bb5-a89d-dcc958deb743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:46:59.461672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bab9-6fd3-4bb5-a89d-dcc958deb743 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:59.463555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bab9-6fd3-4bb5-a89d-dcc958deb743 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:59.463868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932bab9-6fd3-4bb5-a89d-dcc958deb743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:59.502928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932bab9-6fd3-4bb5-a89d-dcc958deb743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:59.508263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932bab9-6fd3-4bb5-a89d-dcc958deb743 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:59.532651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:46:59.533559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 825/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:46:59.535691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:46:59.581081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 811/1636] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:46:59.655354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:46:59.655591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:46:59.655887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:46:59.738178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] MFA Rules not processed for user `5e17c579fd154e079c6070735d3c10b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:46:59.739469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:46:59.823594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:46:59.913867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 826/1637] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:46:59.919348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.059911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.060370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d49029-bd2f-4a1d-aa90-44c0f91569dc service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.072998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146b8de-b339-41de-a279-7d8bd9cd7cd9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.075572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.076484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.076777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.077057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.077803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.077939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.079265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.079670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.079893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.080014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.160734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 812/1638] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:46:59 2022] POST /identity/v3/projects => generated 405 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:00.161656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.189634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:00.289797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.295334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.330002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247658f3-52d5-484a-bc19-067223e68236 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.356300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.357186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.358316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 827/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:00.358791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.359246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.360282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.363233 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.439097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 813/1640] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:00 2022] POST /identity/v3/users => generated 309 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:00.442986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.461983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0c12-c1b5-4f30-8424-41a781b7e403 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.481493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.482007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.482292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.484804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.494831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.503029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.532657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 828/1641] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:00.537429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.555864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a914795-2d4e-4c79-9de9-744039dbbecf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.564395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.566387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.566881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.567270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] PATH_INFO: `/v3/projects/733a54c82cbc4d949a87ed51c91cc8b2/users/48c6cd70cb7d4d53877786f771580857/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.616818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733a54c82cbc4d949a87ed51c91cc8b2, user_id=48c6cd70cb7d4d53877786f771580857, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.620044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.647270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 814/1642] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:00 2022] PUT /identity/v3/projects/733a54c82cbc4d949a87ed51c91cc8b2/users/48c6cd70cb7d4d53877786f771580857/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:00.655791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.667179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accebcfc-db50-44d7-aeb7-65bb7c64508b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.791635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.792334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.792608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.792885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.793617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.795707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.817202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 829/1643] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:00.822004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:00.840730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00434bfe-a976-4240-8204-2d4e06732391 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:00.849725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0657c7-f502-498e-90bf-1f85a51d7fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:00.850823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0657c7-f502-498e-90bf-1f85a51d7fee admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:00.851332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0657c7-f502-498e-90bf-1f85a51d7fee admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:00.851765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0657c7-f502-498e-90bf-1f85a51d7fee admin admin] PATH_INFO: `/v3/projects/733a54c82cbc4d949a87ed51c91cc8b2/users/48c6cd70cb7d4d53877786f771580857/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:00.855897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0657c7-f502-498e-90bf-1f85a51d7fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=733a54c82cbc4d949a87ed51c91cc8b2, user_id=48c6cd70cb7d4d53877786f771580857, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:00.859374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0657c7-f502-498e-90bf-1f85a51d7fee admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:00.876140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 815/1644] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:00 2022] PUT /identity/v3/projects/733a54c82cbc4d949a87ed51c91cc8b2/users/48c6cd70cb7d4d53877786f771580857/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:02.823375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:02.837719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44159645-8917-4381-b58e-99ff32f668b6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:03.097464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:03.108614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:03.109050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:03.109482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] PATH_INFO: `/v3/users/915a9e7b337643f8a2b7a0ff1cc1df33` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:03.114627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915a9e7b337643f8a2b7a0ff1cc1df33)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:03.116785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:03.137611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:03.244972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915a9e7b337643f8a2b7a0ff1cc1df33'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:03.271117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915a9e7b337643f8a2b7a0ff1cc1df33'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:03.289437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915a9e7b337643f8a2b7a0ff1cc1df33'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:03.290676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915a9e7b337643f8a2b7a0ff1cc1df33'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:03.291331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915a9e7b337643f8a2b7a0ff1cc1df33'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:03.316241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 830/1645] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:02 2022] DELETE /identity/v3/users/915a9e7b337643f8a2b7a0ff1cc1df33 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:03.317969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3627-a771-47c0-9bca-33228ede6240 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:03.318433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3627-a771-47c0-9bca-33228ede6240 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:03.318529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e3627-a771-47c0-9bca-33228ede6240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:03.363171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-105e3627-a771-47c0-9bca-33228ede6240 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:03.365084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-105e3627-a771-47c0-9bca-33228ede6240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:03.524492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 816/1646] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:03.572644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:03.575009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:03.742225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f6dc-8b7f-48f9-985a-60909d4a3890 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:03.751520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:03.751751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:03.752033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:03.752313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:03.777554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:03.779019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:03.826837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 831/1647] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:04.268678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381226f5-1939-480f-9ea0-d0769cfb2e6d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:04.269550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381226f5-1939-480f-9ea0-d0769cfb2e6d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:04.269865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381226f5-1939-480f-9ea0-d0769cfb2e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:04.329528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-381226f5-1939-480f-9ea0-d0769cfb2e6d None None] MFA Rules not processed for user `48c6cd70cb7d4d53877786f771580857`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:04.330938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-381226f5-1939-480f-9ea0-d0769cfb2e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:04.485803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:04.527538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 817/1648] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:04 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:05.975178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:05.977347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:05.995597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcfc40-5421-4ebf-b937-568e131a201c service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:06.009186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:06.011359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:06.021802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:06.022278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] PATH_INFO: `/v3/projects/50f73d4811f04b37bb1b4653a1578f3d` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:06.024911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] RBAC: Authorizing `identity:delete_project(project_id=50f73d4811f04b37bb1b4653a1578f3d)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:06.026251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: WARNING py.warnings [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:47:06.026251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: warnings.warn(msg) Jul 06 13:47:06.026251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: Jul 06 13:47:06.028922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:06.141592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50f73d4811f04b37bb1b4653a1578f3d', 'request_id': 'req-1cad931d-8c56-4f6c-b031-a39f663bf71a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:06.170994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50f73d4811f04b37bb1b4653a1578f3d', 'request_id': 'req-1cad931d-8c56-4f6c-b031-a39f663bf71a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:06.182485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50f73d4811f04b37bb1b4653a1578f3d', 'request_id': 'req-1cad931d-8c56-4f6c-b031-a39f663bf71a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:06.201275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] The token cache is being invalidate because project 50f73d4811f04b37bb1b4653a1578f3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:06.201968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:06.209055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1cad931d-8c56-4f6c-b031-a39f663bf71a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:06.212311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 832/1649] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:05 2022] DELETE /identity/v3/projects/50f73d4811f04b37bb1b4653a1578f3d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:06.217050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:06.217527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:06.217647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:06.261280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:06.262520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:06.486130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 818/1650] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:06.493164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:06.493455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:06.493731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:06.504121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:06.544510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:06.545668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:06.581809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 833/1651] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:06.583140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:06.649219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab6a74-9db2-44a8-bc24-6c466a1a5856 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:06.672451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:06.673550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:06.675132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:06.676078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:06.677007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:06.677325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:06.678957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:06.715149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:06.721217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 819/1652] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:06.728008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fc837-bf3b-4fd3-a619-2085e783bc68 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:06.743993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:06.756667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:06.758571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:06.759044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:06.760239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:06.767873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:06.826785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:06.829031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:06.853236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 834/1653] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:06 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:06.860678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:06.866385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cefb99-04f5-4e17-b7bf-1c4de896ce61 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.035655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbbde-41c1-4394-acf4-d0410b6a2561 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.045273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.046425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.047811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.048764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.051074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.055690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:07.092141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.093378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.095339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.105934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] PATH_INFO: `/v3/users/8294e8eb82634a869a69d0bc71a23b14` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.111742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 835/1654] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:06 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:07.113098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:07.113765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8294e8eb82634a869a69d0bc71a23b14)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.114869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: WARNING py.warnings [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 13:47:07.114869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: warnings.warn(msg) Jul 06 13:47:07.114869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: Jul 06 13:47:07.116251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:07.127740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b419f0d-0fd0-4e72-8b14-b254e44027fc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.137053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.137806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.138183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.138531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.139458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.141248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:07.156218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 836/1655] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:07.157673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:07.189389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e313c-77b3-4335-8a7f-1d68b62b4bbb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.199508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.200197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.200484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.200764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.202276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.203110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:07.230965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 837/1656] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:07.232528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:07.256936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3ec68-8c16-4851-bcaa-944240513112 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.271083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.272090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.272384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.272660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] PATH_INFO: `/v3/projects/4f8961e773fc4faab19af257801557b6/users/bfcc64c256744f6ea4920e0246303da6/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.282784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8294e8eb82634a869a69d0bc71a23b14'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:07.283578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8294e8eb82634a869a69d0bc71a23b14'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:07.310682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8294e8eb82634a869a69d0bc71a23b14'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:07.311803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8294e8eb82634a869a69d0bc71a23b14'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:07.367679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3aded7a0-db74-4bba-9e3c-445cc8b1eacc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8294e8eb82634a869a69d0bc71a23b14'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:07.371484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:07.398386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 820/1657] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:06 2022] DELETE /identity/v3/users/8294e8eb82634a869a69d0bc71a23b14 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:07.402678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c6eea-1448-44ba-b664-38ae80a31a89 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.403143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c6eea-1448-44ba-b664-38ae80a31a89 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.403583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c6eea-1448-44ba-b664-38ae80a31a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.428657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-121c6eea-1448-44ba-b664-38ae80a31a89 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:07.430113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-121c6eea-1448-44ba-b664-38ae80a31a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:07.591676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 821/1658] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:07.593168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8961e773fc4faab19af257801557b6, user_id=bfcc64c256744f6ea4920e0246303da6, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.596595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:07.634939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 838/1659] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:07 2022] PUT /identity/v3/projects/4f8961e773fc4faab19af257801557b6/users/bfcc64c256744f6ea4920e0246303da6/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:07.636326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.636692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.636971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.644697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:07.648085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:07.725183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] MFA Rules not processed for user `bfcc64c256744f6ea4920e0246303da6`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:07.726455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:07.807964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d83cb5-dac6-4256-b866-d33bf4ee9dc5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.812145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.812814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.813101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.813379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.855228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:07.881351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 822/1660] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:07.885610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:07.887614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:07.898664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.900564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:07.914451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 839/1661] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:07.919025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6304a4-1b2b-4270-bfae-7eb0e3ee33eb None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:07.930605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05bf5a-c5cb-47a5-8a24-12b580a2651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:07.931065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05bf5a-c5cb-47a5-8a24-12b580a2651d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:07.931376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05bf5a-c5cb-47a5-8a24-12b580a2651d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:07.931662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05bf5a-c5cb-47a5-8a24-12b580a2651d admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:07.932382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05bf5a-c5cb-47a5-8a24-12b580a2651d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:07.934356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f05bf5a-c5cb-47a5-8a24-12b580a2651d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.001798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 823/1662] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:07 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:08.003207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:08.020269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08247b-d6b4-45ab-b84f-ab3e6f736331 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:08.028221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd125d7c-cb95-42a9-94e5-be8a04d62397 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.029173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd125d7c-cb95-42a9-94e5-be8a04d62397 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.029173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd125d7c-cb95-42a9-94e5-be8a04d62397 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.031845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 824/1663] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:47:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:08.051433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.051888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.052318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.127495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:08.130005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:08.152820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:08.153987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.154414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.154858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.156091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:08.162614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.228296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 840/1664] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:08 2022] POST /identity/v3/users => generated 299 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:08.232581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:08.256662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01f12-b844-4fb1-993b-9ec8ef2ee07c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:08.262645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:08.266373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfde76-c42e-4b9a-8462-fc8fd8bec648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:08.267498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfde76-c42e-4b9a-8462-fc8fd8bec648 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.268010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfde76-c42e-4b9a-8462-fc8fd8bec648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.268785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfde76-c42e-4b9a-8462-fc8fd8bec648 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.269873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfde76-c42e-4b9a-8462-fc8fd8bec648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:08.272013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfde76-c42e-4b9a-8462-fc8fd8bec648 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.287009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 825/1665] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:08.306012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 841/1666] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:08.307907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:08.336176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27df553-4ef2-4d65-b016-db6660b7ec78 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:08.348701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:08.350105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.350652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.351901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] PATH_INFO: `/v3/projects/01bebfd8513448d38644a056ac920e20/users/42c7c76a9617467ba1dea619db0ca539/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.358511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4ba3-a851-45bf-a4ff-d64ab896de19 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.358511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4ba3-a851-45bf-a4ff-d64ab896de19 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.358511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4ba3-a851-45bf-a4ff-d64ab896de19 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.364878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 842/1667] 10.222.0.25 () {54 vars in 960 bytes} [Wed Jul 6 13:47:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:08.379941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0928-94ab-414a-9359-04860beca9ee None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.380229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0928-94ab-414a-9359-04860beca9ee None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.380608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183c0928-94ab-414a-9359-04860beca9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.381427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bebfd8513448d38644a056ac920e20, user_id=42c7c76a9617467ba1dea619db0ca539, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:08.386715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.423974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 826/1668] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:08 2022] PUT /identity/v3/projects/01bebfd8513448d38644a056ac920e20/users/42c7c76a9617467ba1dea619db0ca539/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:08.429783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:08.456535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-183c0928-94ab-414a-9359-04860beca9ee None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:08.459085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-183c0928-94ab-414a-9359-04860beca9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:08.637461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b13ef-6e0a-43db-9443-8b941a0a3114 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:08.676437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:08.678347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.678644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.684525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.689677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:08.698752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.717919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 843/1669] 10.222.0.25 () {58 vars in 1057 bytes} [Wed Jul 6 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:08.726825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c0928-94ab-414a-9359-04860beca9ee None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:08.734916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 827/1670] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:08.739541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:08.750260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183c0928-94ab-414a-9359-04860beca9ee None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:08.774462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98be501-4eda-4a0a-a6e3-c496d1ab6980 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:08.779511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b0375-8d95-47f9-91b9-d07ba6c5ff80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:08.780210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b0375-8d95-47f9-91b9-d07ba6c5ff80 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.780496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b0375-8d95-47f9-91b9-d07ba6c5ff80 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.781415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b0375-8d95-47f9-91b9-d07ba6c5ff80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.806588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9bd83-cad7-4322-b3df-99c1018012c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:08.807576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9bd83-cad7-4322-b3df-99c1018012c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.807864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9bd83-cad7-4322-b3df-99c1018012c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.813219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9bd83-cad7-4322-b3df-99c1018012c1 admin admin] PATH_INFO: `/v3/projects/01bebfd8513448d38644a056ac920e20/users/42c7c76a9617467ba1dea619db0ca539/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.819250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9bd83-cad7-4322-b3df-99c1018012c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01bebfd8513448d38644a056ac920e20, user_id=42c7c76a9617467ba1dea619db0ca539, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:08.824630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9bd83-cad7-4322-b3df-99c1018012c1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.826357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b0375-8d95-47f9-91b9-d07ba6c5ff80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:08.829087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4b0375-8d95-47f9-91b9-d07ba6c5ff80 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:08.863137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 828/1671] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:08 2022] PUT /identity/v3/projects/01bebfd8513448d38644a056ac920e20/users/42c7c76a9617467ba1dea619db0ca539/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:08.865566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 844/1672] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:08.865871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.866167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.866448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.876069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:08.876362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:08.876750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:08.966022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] MFA Rules not processed for user `42c7c76a9617467ba1dea619db0ca539`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:08.970256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:09.007866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] MFA Rules not processed for user `2d912686df5d42a58f7369bd5d2b9d25`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:09.011252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:09.018428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:09.155101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 845/1673] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:09.163983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:09.167239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:09.211221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 829/1674] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:09.232227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:09.233347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:09.314976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe499ac4-eae2-4679-ae7d-da24ac2507cd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:09.325897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:09.326893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:09.327030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:09.327374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:09.340216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:09.341980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:09.348907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:09.358262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 846/1675] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:09.359284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:09.363782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:09.398161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f7a4e-3549-476c-8d86-a128cd48dce6 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:09.411963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:09.413426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:09.413808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:09.414809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:09.438764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:09.442374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:09.457836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 830/1676] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:09.458762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:09.530502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7523c-a600-4689-b261-05a5fbcc5f5a service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:09.547993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:09.549247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:09.550111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:09.551708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] PATH_INFO: `/v3/projects/804dae743e8f451893b6c87ba2166444` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:09.556181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=804dae743e8f451893b6c87ba2166444)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:09.558420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:09.623286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a799a-0b84-494f-8c02-249d1cb21dd5 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:09.643210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:09.645455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:09.646730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:09.646838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] PATH_INFO: `/v3/users/bfcc64c256744f6ea4920e0246303da6` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:09.651192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcc64c256744f6ea4920e0246303da6)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:09.659451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:09.774950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '804dae743e8f451893b6c87ba2166444', 'request_id': 'req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.798454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '804dae743e8f451893b6c87ba2166444', 'request_id': 'req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.826873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '804dae743e8f451893b6c87ba2166444', 'request_id': 'req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.830916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:09.859378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] The token cache is being invalidate because project 804dae743e8f451893b6c87ba2166444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:09.860848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.864157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-87fd5c0d-50d0-4ca6-a2df-11b4d0f115fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.872389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 847/1677] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:09 2022] DELETE /identity/v3/projects/804dae743e8f451893b6c87ba2166444 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:09.872564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcc64c256744f6ea4920e0246303da6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.875057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcc64c256744f6ea4920e0246303da6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.875983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d14b8d-d852-46cd-9d28-a3829b9d0833 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:09.877132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d14b8d-d852-46cd-9d28-a3829b9d0833 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:09.877467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d14b8d-d852-46cd-9d28-a3829b9d0833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:09.914721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcc64c256744f6ea4920e0246303da6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.914721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcc64c256744f6ea4920e0246303da6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.941561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-90a1c6ee-64b0-4376-a6e9-4ccf639f16ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcc64c256744f6ea4920e0246303da6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:09.943832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d8d14b8d-d852-46cd-9d28-a3829b9d0833 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:09.946530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d8d14b8d-d852-46cd-9d28-a3829b9d0833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:09.968345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 831/1678] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:09 2022] DELETE /identity/v3/users/bfcc64c256744f6ea4920e0246303da6 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:09.973284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:09.973495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:09.974014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:09.998587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:09.999987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:10.060647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 848/1679] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:10.068123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.068554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.069592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.096214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:10.120485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:10.121808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:10.125819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 832/1680] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:10.143836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.145206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:10.162645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 849/1681] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:10.166393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.193027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd52e7-113e-4120-b5c3-b03332f09084 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.198940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.199698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.199986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.200496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.205323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:10.205642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.207808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.232659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 850/1682] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:10.238063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.259422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea32f2-8148-4e76-b1e6-1edc1d4bb4d9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.262176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b67616-f967-418a-965a-fef60376df7d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.263301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.263999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.264281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.264646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.272928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.273612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.273899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.274180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.276024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.277537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.277893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.280195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.288668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 833/1683] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:10.392420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 851/1684] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:10 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:10.395262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.405975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafd6b0-11aa-4ee2-9490-5abd883f4ea7 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.560661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b441fd-b63a-4803-9449-ed67c0754f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.561399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b441fd-b63a-4803-9449-ed67c0754f8c admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.561765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b441fd-b63a-4803-9449-ed67c0754f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.562112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b441fd-b63a-4803-9449-ed67c0754f8c admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.562928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b441fd-b63a-4803-9449-ed67c0754f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.565167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b441fd-b63a-4803-9449-ed67c0754f8c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.611445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.612488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 834/1685] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:10 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:10.624735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa59c-56f4-4cc1-a5f5-c47ced8869ed None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.625034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa59c-56f4-4cc1-a5f5-c47ced8869ed None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.625296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3fa59c-56f4-4cc1-a5f5-c47ced8869ed None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.629429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489a567-65d3-46fe-83a5-c934f09ec208 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.632250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 835/1686] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 13:47:10.645933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.646638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.646924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.647198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.648080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.649708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.662436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.663082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.663506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.699802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 852/1687] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:10.700899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.706943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] MFA Rules not processed for user `54b6895073d447cba46fe3569df20081`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:10.708580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:10.737338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a00b0-80fd-4fb7-a193-c8c9eb2d61dc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.757816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.758850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.760549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.763497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.767011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.772203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.853913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 853/1688] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:10.858502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.897946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dc915-90a7-4bba-a5f6-96c8a9db79ff admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.901981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 836/1689] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:47:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:10.906609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:10.909333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:10.933046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.938861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.939737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.942415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] PATH_INFO: `/v3/projects/2d85d667df7b4295b69910d49c4de558/users/b04ca10566224e34bb3cb0527fd87a7c/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.947159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebe437-fb96-4197-9c98-cab69de37e17 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:10.973862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:10.975542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:10.975821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:10.977590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] PATH_INFO: `/v3/users/5e17c579fd154e079c6070735d3c10b8` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:10.981279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e17c579fd154e079c6070735d3c10b8)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.986867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:10.989623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d85d667df7b4295b69910d49c4de558, user_id=b04ca10566224e34bb3cb0527fd87a7c, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:10.994804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:11.032139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:11.054185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 854/1690] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:10 2022] PUT /identity/v3/projects/2d85d667df7b4295b69910d49c4de558/users/b04ca10566224e34bb3cb0527fd87a7c/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:11.055641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:11.070403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:11.114798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e17c579fd154e079c6070735d3c10b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.117243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e17c579fd154e079c6070735d3c10b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.136535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e17c579fd154e079c6070735d3c10b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.137331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e17c579fd154e079c6070735d3c10b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.165292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e17c579fd154e079c6070735d3c10b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.194810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 837/1691] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:10 2022] DELETE /identity/v3/users/5e17c579fd154e079c6070735d3c10b8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:11.199049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:11.203967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:11.338655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:11.348487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a43cec-5764-4a5c-924e-a268b1c25043 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:11.401012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e27259-f696-4ddc-877d-8910ed3df788 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:11.420851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:11.421765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:11.422048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:11.422326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] PATH_INFO: `/v3/users/5d27e24b081548058e0c6c4fcf579a16` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:11.423835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d27e24b081548058e0c6c4fcf579a16)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:11.426217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:11.537099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d27e24b081548058e0c6c4fcf579a16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.538082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d27e24b081548058e0c6c4fcf579a16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.548577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d27e24b081548058e0c6c4fcf579a16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.549553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d27e24b081548058e0c6c4fcf579a16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.573864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cda84f76-24b0-424c-9bc6-e56422ebd6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d27e24b081548058e0c6c4fcf579a16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:11.574752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:11.575484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:11.575798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:11.576106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:11.584210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:11.604840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 838/1692] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:11 2022] DELETE /identity/v3/users/5d27e24b081548058e0c6c4fcf579a16 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:11.606866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c87a31-3b49-4950-859e-3b7870cc6845 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:11.611782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c87a31-3b49-4950-859e-3b7870cc6845 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:11.614817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c87a31-3b49-4950-859e-3b7870cc6845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:11.617729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:11.619708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401d6cb-0299-421b-9b95-05ba1ec499a4 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:11.646594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:11.662857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-79c87a31-3b49-4950-859e-3b7870cc6845 None None] MFA Rules not processed for user `b04ca10566224e34bb3cb0527fd87a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:11.662988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 855/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:11.666361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-79c87a31-3b49-4950-859e-3b7870cc6845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:11.666539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:11.666837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:11.667200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:11.725636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:11.732661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:11.799943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 839/1694] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:11.802298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:11.802784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:11.803229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:11.871055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 856/1695] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:11.872016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:11.873373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:11.895124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] MFA Rules not processed for user `29bed120fba74e638d9e9fe1f6d37d46`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:11.897428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:12.055802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 840/1696] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:12.055802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:12.070082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:12.119273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac1746-7a4f-4e59-a848-12e8513fab60 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:12.127128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:12.128568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:12.129078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:12.130851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:12.148435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:12.151567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:12.167511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 857/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:12.169015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:12.171333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:12.195336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7487b7-e278-4966-8669-1fee239b8149 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:12.203810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:12.204974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:12.205072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:12.205448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] PATH_INFO: `/v3/projects/9f862e095814417081524fd8773394a2` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:12.207473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f862e095814417081524fd8773394a2)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:12.211973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:12.216198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4a49c-91df-4d1a-85a6-b98831e183ea None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:12.231198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:12.231884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:12.232175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:12.232454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:12.248461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:12.258769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:12.260274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:12.272631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 841/1698] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:12.273483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:12.274797 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:12.297693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffafca8-78ca-4250-bb26-651d0e483c44 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:12.322321 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:12.323641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:12.324308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:12.329262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:12.344924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:12.347495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:12.362271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f862e095814417081524fd8773394a2', 'request_id': 'req-edc3ad9d-682b-4508-86e2-2c1948fc03ea'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.379842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f862e095814417081524fd8773394a2', 'request_id': 'req-edc3ad9d-682b-4508-86e2-2c1948fc03ea'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.382124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 842/1699] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:12.409932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f862e095814417081524fd8773394a2', 'request_id': 'req-edc3ad9d-682b-4508-86e2-2c1948fc03ea'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.437356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] The token cache is being invalidate because project 9f862e095814417081524fd8773394a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:12.437661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.438343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.441080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 858/1700] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:12 2022] DELETE /identity/v3/projects/9f862e095814417081524fd8773394a2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:12.445116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:12.478389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b783a8-1391-4491-8253-2022224441f0 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:12.524620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:12.530663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:12.544147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:12.678119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:12.679107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:12.679577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:12.679935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] PATH_INFO: `/v3/users/48c6cd70cb7d4d53877786f771580857` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:12.682207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c6cd70cb7d4d53877786f771580857)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:12.684368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:12.738355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3ad9d-682b-4508-86e2-2c1948fc03ea admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:12.751162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:12.753296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:12.753624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:12.753917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] PATH_INFO: `/v3/users/b04ca10566224e34bb3cb0527fd87a7c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:12.759050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04ca10566224e34bb3cb0527fd87a7c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:12.774835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:12.844290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c6cd70cb7d4d53877786f771580857'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.845509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c6cd70cb7d4d53877786f771580857'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.877005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c6cd70cb7d4d53877786f771580857'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.878869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c6cd70cb7d4d53877786f771580857'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.912682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c6cd70cb7d4d53877786f771580857'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:12.934585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 843/1701] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:12 2022] DELETE /identity/v3/users/48c6cd70cb7d4d53877786f771580857 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:12.934585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:12.943424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:12.980416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04ca10566224e34bb3cb0527fd87a7c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.020787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04ca10566224e34bb3cb0527fd87a7c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.056779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04ca10566224e34bb3cb0527fd87a7c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.058675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04ca10566224e34bb3cb0527fd87a7c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.060382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7d8ba39d-d580-4715-98a0-a03e6165f65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04ca10566224e34bb3cb0527fd87a7c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.120977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 859/1702] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:12 2022] DELETE /identity/v3/users/b04ca10566224e34bb3cb0527fd87a7c => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:13.125593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:13.130451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:13.130792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:13.182170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f222ea-5561-4d5a-8a8e-5553b29f317a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:13.184377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:13.185785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:13.276864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:13.354796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:13.372144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 860/1703] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:13.399774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:13.400793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:13.401072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:13.402495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] PATH_INFO: `/v3/projects/4f8961e773fc4faab19af257801557b6` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:13.405855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:13.406149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8961e773fc4faab19af257801557b6)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:13.410153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:13.410380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:13.549500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c990419-8ab5-4291-a7ec-83df5e0c071b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:13.565288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8961e773fc4faab19af257801557b6', 'request_id': 'req-be8a7374-eac2-4fec-aa20-cb46c79c39a5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.587823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8961e773fc4faab19af257801557b6', 'request_id': 'req-be8a7374-eac2-4fec-aa20-cb46c79c39a5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.599976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8961e773fc4faab19af257801557b6', 'request_id': 'req-be8a7374-eac2-4fec-aa20-cb46c79c39a5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.640866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] The token cache is being invalidate because project 4f8961e773fc4faab19af257801557b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:13.641165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.643287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:13.649810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 844/1704] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:12 2022] DELETE /identity/v3/projects/4f8961e773fc4faab19af257801557b6 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:13.664409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:13.664535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:13.669283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:13.675517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:13.676898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:13.679268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:13.685517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:13.928200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a7374-eac2-4fec-aa20-cb46c79c39a5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:13.930482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:13.934582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:13.964439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:13.965609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:13.965920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:13.966200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] PATH_INFO: `/v3/users/42c7c76a9617467ba1dea619db0ca539` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:13.967541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c7c76a9617467ba1dea619db0ca539)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:13.969531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:13.980985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 861/1705] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:13.982745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:13.984847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:14.019977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ebe88-5172-4dbd-89ed-7343c3173ef0 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:14.028200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:14.029409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:14.032528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:14.032972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] PATH_INFO: `/v3/projects/55f9c839d7aa4ce199b8ccd1de3a3c04` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:14.036544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] RBAC: Authorizing `identity:delete_project(project_id=55f9c839d7aa4ce199b8ccd1de3a3c04)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:14.041098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:14.104235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c7c76a9617467ba1dea619db0ca539'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.104949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c7c76a9617467ba1dea619db0ca539'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.107044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:14.126812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c7c76a9617467ba1dea619db0ca539'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.128196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c7c76a9617467ba1dea619db0ca539'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.153972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6ebc764-3daf-44bb-a03f-5c1eb78768d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c7c76a9617467ba1dea619db0ca539'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.165975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55f9c839d7aa4ce199b8ccd1de3a3c04', 'request_id': 'req-15354ea5-f70a-4f30-a479-062d1a38566a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.167390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:14.185353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 845/1706] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:13 2022] DELETE /identity/v3/users/42c7c76a9617467ba1dea619db0ca539 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:14.187474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55f9c839d7aa4ce199b8ccd1de3a3c04', 'request_id': 'req-15354ea5-f70a-4f30-a479-062d1a38566a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.221281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55f9c839d7aa4ce199b8ccd1de3a3c04', 'request_id': 'req-15354ea5-f70a-4f30-a479-062d1a38566a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.266426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] The token cache is being invalidate because project 55f9c839d7aa4ce199b8ccd1de3a3c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:14.266730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.267439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-15354ea5-f70a-4f30-a479-062d1a38566a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.276054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 862/1707] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:13 2022] DELETE /identity/v3/projects/55f9c839d7aa4ce199b8ccd1de3a3c04 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:14.278085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:14.278475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:14.278866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:14.308815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:14.310244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:14.427994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 846/1708] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:14.430104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aead2-0ad7-4191-ab8f-e8086388472a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:14.430598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aead2-0ad7-4191-ab8f-e8086388472a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:14.430754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287aead2-0ad7-4191-ab8f-e8086388472a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:14.467869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:14.469725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:14.491470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-287aead2-0ad7-4191-ab8f-e8086388472a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:14.498135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-287aead2-0ad7-4191-ab8f-e8086388472a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:14.516293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7796f-7cd3-4b8b-92e1-c796a4c8c929 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:14.539731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 863/1709] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:14.543987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:14.544515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635248-c3f1-4a1a-8de1-11b6d95556a1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:14.544808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635248-c3f1-4a1a-8de1-11b6d95556a1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:14.546013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:14.546297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:14.546571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] PATH_INFO: `/v3/projects/733a54c82cbc4d949a87ed51c91cc8b2` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:14.595417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e635248-c3f1-4a1a-8de1-11b6d95556a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:14.596297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=733a54c82cbc4d949a87ed51c91cc8b2)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:14.596297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:14.672963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5e635248-c3f1-4a1a-8de1-11b6d95556a1 None None] MFA Rules not processed for user `0d6f85dc30f54c2eb9f6c78a1c93fe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:14.675452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5e635248-c3f1-4a1a-8de1-11b6d95556a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:14.730888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733a54c82cbc4d949a87ed51c91cc8b2', 'request_id': 'req-346bc256-3d96-400f-bbdd-48731be2bd02'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.744738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733a54c82cbc4d949a87ed51c91cc8b2', 'request_id': 'req-346bc256-3d96-400f-bbdd-48731be2bd02'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.788732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733a54c82cbc4d949a87ed51c91cc8b2', 'request_id': 'req-346bc256-3d96-400f-bbdd-48731be2bd02'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.833345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] The token cache is being invalidate because project 733a54c82cbc4d949a87ed51c91cc8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:14.833606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.834720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:14.842483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 847/1710] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:14 2022] DELETE /identity/v3/projects/733a54c82cbc4d949a87ed51c91cc8b2 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:14.843546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:14.849127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:14.913511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 864/1711] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:14.934237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:14.934685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:14.935101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.002384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:15.007107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.121713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346bc256-3d96-400f-bbdd-48731be2bd02 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.147975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.148674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.148983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.151465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.152283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:15.152594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.154276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bb998-a989-4b21-86d1-fdbfb627ceb3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.187593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 848/1712] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:15.191073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.192818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.192818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.221149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 865/1713] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:15.225321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.226729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.244117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] MFA Rules not processed for user `0d6f85dc30f54c2eb9f6c78a1c93fe5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:15.245346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.257787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e690e-53b5-433a-ac06-b693bbddd413 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.262514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:15.273679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.273875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.274092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.274552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] PATH_INFO: `/v3/projects/01bebfd8513448d38644a056ac920e20` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.277698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01bebfd8513448d38644a056ac920e20)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.279906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.346283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 849/1714] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:15.351879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.353209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:15.368977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824faa3-8b48-4837-bb27-c8747a2dce3f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.394517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01bebfd8513448d38644a056ac920e20', 'request_id': 'req-870fc117-0c63-41f4-8b13-9e8c445b2264'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:15.407948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01bebfd8513448d38644a056ac920e20', 'request_id': 'req-870fc117-0c63-41f4-8b13-9e8c445b2264'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:15.429506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01bebfd8513448d38644a056ac920e20', 'request_id': 'req-870fc117-0c63-41f4-8b13-9e8c445b2264'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:15.450581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] The token cache is being invalidate because project 01bebfd8513448d38644a056ac920e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:15.451236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:15.451794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-870fc117-0c63-41f4-8b13-9e8c445b2264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:15.454108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 866/1715] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:15 2022] DELETE /identity/v3/projects/01bebfd8513448d38644a056ac920e20 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:15.458763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.459538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.459646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d1ae-47c5-44fa-bd66-d09e55b2a9f1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.459842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.459938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d1ae-47c5-44fa-bd66-d09e55b2a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.460095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.460200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8d1ae-47c5-44fa-bd66-d09e55b2a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.460798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.462712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.499002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 850/1716] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/projects => generated 365 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:15.500439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.504252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.519947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8fe8d1ae-47c5-44fa-bd66-d09e55b2a9f1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:15.521177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8fe8d1ae-47c5-44fa-bd66-d09e55b2a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.629484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa52b61-ccc3-458a-a48f-6e783d7de2b4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.637901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.638989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.639568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.639962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.642254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.666365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 867/1717] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:15.667746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.668036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.668314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.712455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:15.716677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.725226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:15.750139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 868/1718] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:15.750139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.750139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.762277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.766636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.777093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4105-52af-4e3f-851c-3f427d8e88d7 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.806585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b38a7-d98a-4f91-8216-77ae7da8254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.806753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 851/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:15.807071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b38a7-d98a-4f91-8216-77ae7da8254c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.807378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b38a7-d98a-4f91-8216-77ae7da8254c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.807659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b38a7-d98a-4f91-8216-77ae7da8254c admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.808366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b38a7-d98a-4f91-8216-77ae7da8254c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.810311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b38a7-d98a-4f91-8216-77ae7da8254c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.812734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.840764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9845091-05fd-452a-acaa-e9f3e903e3a9 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.851404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.852077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.852360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.852727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.853371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:15.853716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.855404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.870850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 869/1720] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:15.872341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.872634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.873322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.897314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 852/1721] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:15.898307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.934005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2314-7df8-41e8-b268-2edf467f5984 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:15.938998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:15.940287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:15.951463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:15.952219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:15.952590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:15.952935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:15.955379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:15.957632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:15.968201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 870/1722] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:15.969123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:15.988228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb8288-32be-4eed-b6c5-046141264231 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.004252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.004941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.005225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.005501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.006205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.010766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 853/1723] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:16.014233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.016559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.031070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32533794-58cd-41a3-af66-f6a795bb0d7a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.059111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.064985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.067006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.068375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.071241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:16.072159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.079858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.082903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 871/1724] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:15 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:16.088009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.128687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 854/1725] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:16.137187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.157149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd9d5e-bfa2-4720-b833-6845b6f16270 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.259621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221364e-4b65-4749-9c82-ae02cc26be0c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.269723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.270568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.271829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.272544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.283409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.284933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.285840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.286642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.287447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.288392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.288993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.292594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.319442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 872/1726] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:16.320530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.328960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:16.335093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 855/1727] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:16 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:16.336180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.338761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:16.341681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a848b5f-92ea-454e-91f5-fbd696a5323a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.361444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.362321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.363488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.366315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.368748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0edc8c-fdc8-412e-9580-19899f81a2cb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.369643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.371782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.373665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.374849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.375137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.375444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] PATH_INFO: `/v3/projects/2d85d667df7b4295b69910d49c4de558` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.378831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d85d667df7b4295b69910d49c4de558)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.381567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.450952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 873/1728] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:16 2022] POST /identity/v3/projects => generated 359 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:16.453648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.483520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d85d667df7b4295b69910d49c4de558', 'request_id': 'req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:16.498769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d85d667df7b4295b69910d49c4de558', 'request_id': 'req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:16.516971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d85d667df7b4295b69910d49c4de558', 'request_id': 'req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:16.548686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] The token cache is being invalidate because project 2d85d667df7b4295b69910d49c4de558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:16.551506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:16.553024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:16.567464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 856/1729] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:16 2022] DELETE /identity/v3/projects/2d85d667df7b4295b69910d49c4de558 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:16.568606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.582180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:16.621216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d36735-f23e-479c-b3e2-5a996ea08fc8 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.641082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.642539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.643166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.644986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] PATH_INFO: `/v3/projects/ef28d69451e54f0eb36917a27731feef/users/58d270e9688a4552afe883fdf2f3522e/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.661436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:16.705466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef28d69451e54f0eb36917a27731feef, user_id=58d270e9688a4552afe883fdf2f3522e, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.717848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.758194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 874/1730] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:16 2022] PUT /identity/v3/projects/ef28d69451e54f0eb36917a27731feef/users/58d270e9688a4552afe883fdf2f3522e/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:16.759139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:16.762672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:16.800454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42bf6-ae99-4fd3-90b0-ab4bba9feab7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.969693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64044ab-9615-47fe-948f-efbceddbe06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.970381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64044ab-9615-47fe-948f-efbceddbe06c admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.970676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64044ab-9615-47fe-948f-efbceddbe06c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.970942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64044ab-9615-47fe-948f-efbceddbe06c admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.975155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64044ab-9615-47fe-948f-efbceddbe06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.977967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e165dbd9-fba3-4e94-8491-2025101c60c5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:16.978661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64044ab-9615-47fe-948f-efbceddbe06c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:16.989951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8c17b-b8b1-4082-8aaf-aa26b61dd455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:16.990657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c17b-b8b1-4082-8aaf-aa26b61dd455 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:16.995150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c17b-b8b1-4082-8aaf-aa26b61dd455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:16.995525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8c17b-b8b1-4082-8aaf-aa26b61dd455 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:16.996456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8c17b-b8b1-4082-8aaf-aa26b61dd455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:16.998318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8c17b-b8b1-4082-8aaf-aa26b61dd455 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.004576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 857/1731] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:17.009194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f6e4-5f72-472d-9938-3bc163e5571f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.015191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f6e4-5f72-472d-9938-3bc163e5571f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.015856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747f6e4-5f72-472d-9938-3bc163e5571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.058144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 875/1732] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:16 2022] POST /identity/v3/users => generated 280 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:17.060495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f747f6e4-5f72-472d-9938-3bc163e5571f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:17.061419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a154949-1ae0-4dcd-8e2d-52b9ab325d3b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.061932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f747f6e4-5f72-472d-9938-3bc163e5571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.062227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a154949-1ae0-4dcd-8e2d-52b9ab325d3b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.064476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a154949-1ae0-4dcd-8e2d-52b9ab325d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.089374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 858/1733] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:17.090997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542cef0-3393-486e-97fb-6739f5fba3bf None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.091354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542cef0-3393-486e-97fb-6739f5fba3bf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.091570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542cef0-3393-486e-97fb-6739f5fba3bf None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.093992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 859/1734] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 13:47:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:17.094835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542cef0-3393-486e-97fb-6739f5fba3bf None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.119161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2a154949-1ae0-4dcd-8e2d-52b9ab325d3b None None] MFA Rules not processed for user `58d270e9688a4552afe883fdf2f3522e`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:17.121355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2a154949-1ae0-4dcd-8e2d-52b9ab325d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.135446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542cef0-3393-486e-97fb-6739f5fba3bf None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.154228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.154911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.155194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.155503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.156262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.157869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.186608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:17.188523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 860/1735] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:17.192954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.204652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaadb6-579f-4038-8512-520691ac6a2e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.209752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5628b-16b4-43d9-b0ab-ef0f5bd3418d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.210432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5628b-16b4-43d9-b0ab-ef0f5bd3418d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.210727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5628b-16b4-43d9-b0ab-ef0f5bd3418d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.210987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5628b-16b4-43d9-b0ab-ef0f5bd3418d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.211757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5628b-16b4-43d9-b0ab-ef0f5bd3418d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.213434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5628b-16b4-43d9-b0ab-ef0f5bd3418d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.236637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 861/1736] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:17.240589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 876/1737] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:17.240727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.240727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.240907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.240988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.241065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.250661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.280662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:17.282839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.320646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 862/1738] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:17.321351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.333609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d89806-701d-41c2-8cbf-1b75754fe562 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.339592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.340882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.341269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.341717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:17.341822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] PATH_INFO: `/v3/projects/e76cd0f715904af995e1be6d2cc82e7e/users/1301d79cdb5749a4afcb30eaf677f834/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.342971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.364316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cd0f715904af995e1be6d2cc82e7e, user_id=1301d79cdb5749a4afcb30eaf677f834, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.368328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.403504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 863/1739] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:17 2022] PUT /identity/v3/projects/e76cd0f715904af995e1be6d2cc82e7e/users/1301d79cdb5749a4afcb30eaf677f834/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:17.403504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.439453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 877/1740] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:17.440663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.442621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.462556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1d6443-3ad1-4499-b824-e6ab820ddbf1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.481426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692f147-85b5-498d-89be-6d5755075be9 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.485974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.486841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.487218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.487666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.488530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.490252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.492244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:17.518051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 864/1741] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:17.519862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.536194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb758f-ae18-4b34-abe0-66e1bf5040ce admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.541757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c495670-2808-401b-b16b-163def09280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.542928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495670-2808-401b-b16b-163def09280e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.543507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495670-2808-401b-b16b-163def09280e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.543926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c495670-2808-401b-b16b-163def09280e admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.544803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495670-2808-401b-b16b-163def09280e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:17.545315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495670-2808-401b-b16b-163def09280e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.547110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c495670-2808-401b-b16b-163def09280e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.569491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 865/1742] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:17.572860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.573150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.573428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.611273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.611969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.612307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.613045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.613750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.616143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.635708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] MFA Rules not processed for user `1301d79cdb5749a4afcb30eaf677f834`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:17.637842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.662915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 878/1743] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:17.664862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.667930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:17.728924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 866/1744] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:17.730027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.741284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebecff-c2bb-457d-8a98-cc408bf68011 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.769506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb6e1c-233d-48c3-8110-e86980fffbed admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:17.774306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.775078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.775412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.775790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.790003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.791779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.801883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 879/1745] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:17.808014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.829462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:17.854699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:17.855648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:17.855930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:17.856207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] PATH_INFO: `/v3/projects/836139145b03448d92a04bd8d25060dc/users/b80103eeb0624b468f987c92a23ac5e5/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:17.895097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836139145b03448d92a04bd8d25060dc, user_id=b80103eeb0624b468f987c92a23ac5e5, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:17.897814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:17.928526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 867/1746] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:17 2022] PUT /identity/v3/projects/836139145b03448d92a04bd8d25060dc/users/b80103eeb0624b468f987c92a23ac5e5/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:17.928526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:17.936410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d42e3b-3c3d-4a2b-8e78-a843825251bc service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:18.023666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:18.035556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0bb95a-23a8-485f-b4e7-6d52c2557487 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:18.040910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:18.041671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.042027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.042452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.043222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:18.045203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a789358-e521-4551-b2a8-0b4d44d51721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:18.045719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:18.045870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789358-e521-4551-b2a8-0b4d44d51721 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.046153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789358-e521-4551-b2a8-0b4d44d51721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.046431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a789358-e521-4551-b2a8-0b4d44d51721 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.047170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a789358-e521-4551-b2a8-0b4d44d51721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:18.051592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a789358-e521-4551-b2a8-0b4d44d51721 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:18.090897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 868/1747] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:18.094677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:18.097649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 880/1748] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:17 2022] POST /identity/v3/projects => generated 369 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:18.107837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13c72c-591f-413b-873f-1104e106f8ee admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:18.108746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06f1b-f1fe-4902-a0a8-4b24d750a55e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.109148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06f1b-f1fe-4902-a0a8-4b24d750a55e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.109584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06f1b-f1fe-4902-a0a8-4b24d750a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.147747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d6e06f1b-f1fe-4902-a0a8-4b24d750a55e None None] MFA Rules not processed for user `2d912686df5d42a58f7369bd5d2b9d25`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:18.149678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d6e06f1b-f1fe-4902-a0a8-4b24d750a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:18.313228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e587-bf18-4166-a0a6-49808a6c5734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:18.313992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e587-bf18-4166-a0a6-49808a6c5734 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.316474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e587-bf18-4166-a0a6-49808a6c5734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.316944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e587-bf18-4166-a0a6-49808a6c5734 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.318713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e587-bf18-4166-a0a6-49808a6c5734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:18.318865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 881/1749] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:18.320558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.320855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.321140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.324025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898e587-bf18-4166-a0a6-49808a6c5734 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:18.386897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] MFA Rules not processed for user `29bed120fba74e638d9e9fe1f6d37d46`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:18.398240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:18.404726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 869/1750] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:18 2022] POST /identity/v3/projects => generated 373 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:18.407655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.409886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.410430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.489164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] MFA Rules not processed for user `b80103eeb0624b468f987c92a23ac5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:18.489164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:18.507436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:18.563135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 882/1751] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:18.564183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:18.665234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 870/1752] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:18.667840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:18.716715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e677cb4-c0dc-4d62-8e4c-c6a9b0c9736e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:18.728854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:18.731038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.731197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.732126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.733773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:18.738433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:18.773838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 883/1753] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:18.774967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:18.804604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec79a8b-5c3e-4bc2-87af-a358ccab46f1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:18.817044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:18.817790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.818081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.818362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.819073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:18.821161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:18.843290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e570c8c-9aca-47e2-8a34-9010a78db7bf None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:18.852211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:18.853172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:18.853630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:18.854032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:18.855236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:18.858866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:18.868812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:18.896717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 871/1754] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:18 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:18.896717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:18.897283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:18.901057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 884/1755] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:18 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:18.902049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:18.916563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:19.049728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b9e94-c690-4197-8651-9b06a69af427 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.057251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.058395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.058822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.059369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.063622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:19.077895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a853ac0b-98c4-4ff5-88e9-08eff353ac5c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.089166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.089461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.090641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.091143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.091757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.092355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.107948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.110388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.110835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 872/1756] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:19.111890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.122929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 885/1757] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:18 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:19.124399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.140599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f4f4-71f8-4998-85dd-4a94a559d5ed service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.149255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.151082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.151995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.152456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] PATH_INFO: `/v3/projects/e6202323520e4afc982a1eb65622b4e1/users/1b600127d3e44ee0b1b160e2e7363203/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.154863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec853c30-dac1-413f-b73a-7e64dfd193f5 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.165682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.166962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.167259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.167563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.168310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.170129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.179768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6202323520e4afc982a1eb65622b4e1, user_id=1b600127d3e44ee0b1b160e2e7363203, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.184997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.198363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 886/1758] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:19.202048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.205491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 873/1759] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:19 2022] PUT /identity/v3/projects/e6202323520e4afc982a1eb65622b4e1/users/1b600127d3e44ee0b1b160e2e7363203/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:19.207500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.221911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3542da-18c8-4f5b-876e-2fe023787608 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.321407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c470beb-e56c-4e15-8ff4-84ff46d25d24 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.326523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.327434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.327715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.328054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] PATH_INFO: `/v3/users/b80103eeb0624b468f987c92a23ac5e5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.329421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b80103eeb0624b468f987c92a23ac5e5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.334820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.335875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.336361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.336811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.337689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.339720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.342066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:19.347224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.358996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 887/1760] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:19.361047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.406814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd465c0c-6565-4da9-8b20-1de053d7cbd5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.422759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b80103eeb0624b468f987c92a23ac5e5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:19.423543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b80103eeb0624b468f987c92a23ac5e5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:19.426736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.427542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.430736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.431051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.432063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.432354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b80103eeb0624b468f987c92a23ac5e5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:19.433081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b80103eeb0624b468f987c92a23ac5e5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:19.434478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:19.438091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.452968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b80103eeb0624b468f987c92a23ac5e5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:19.463023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 888/1761] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:19.469342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.475634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:19.488024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 874/1762] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:19 2022] DELETE /identity/v3/users/b80103eeb0624b468f987c92a23ac5e5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:19.489354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.491183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:19.510645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e4f92-944a-44c8-bcd0-c2ebb23d64f0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.583301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475781b-d090-4173-ad6f-de13ff9dc74e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.594216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf819a9-b9d8-4d07-87ee-af56b8e52711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.595895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf819a9-b9d8-4d07-87ee-af56b8e52711 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.596398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf819a9-b9d8-4d07-87ee-af56b8e52711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.597118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf819a9-b9d8-4d07-87ee-af56b8e52711 admin admin] PATH_INFO: `/v3/projects/0682dfeacbf949e0b424f02f1fbe0f40/users/5a11f6fb74144991919e72852e5ffb8c/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.623596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf819a9-b9d8-4d07-87ee-af56b8e52711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0682dfeacbf949e0b424f02f1fbe0f40, user_id=5a11f6fb74144991919e72852e5ffb8c, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.629317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf819a9-b9d8-4d07-87ee-af56b8e52711 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.636619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725f72e-af94-42c8-bfce-53b409a28d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.639494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f72e-af94-42c8-bfce-53b409a28d89 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.639862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f72e-af94-42c8-bfce-53b409a28d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.640214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725f72e-af94-42c8-bfce-53b409a28d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.642713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725f72e-af94-42c8-bfce-53b409a28d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.645428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725f72e-af94-42c8-bfce-53b409a28d89 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.654040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 875/1763] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:19 2022] PUT /identity/v3/projects/0682dfeacbf949e0b424f02f1fbe0f40/users/5a11f6fb74144991919e72852e5ffb8c/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:19.655693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaee9e5-1c57-4971-8d19-fcf8c6b09b9b None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.656270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaee9e5-1c57-4971-8d19-fcf8c6b09b9b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.657208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaee9e5-1c57-4971-8d19-fcf8c6b09b9b None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.659073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 876/1764] 10.222.0.25 () {54 vars in 912 bytes} [Wed Jul 6 13:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:19.660575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaee9e5-1c57-4971-8d19-fcf8c6b09b9b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.663396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1eaee9e5-1c57-4971-8d19-fcf8c6b09b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:19.667113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 889/1765] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:19.668665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.669031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.669385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.696187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:19.701392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:19.825737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaee9e5-1c57-4971-8d19-fcf8c6b09b9b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.833092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dab186-7f74-4a47-a37a-71dff2b867b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.834174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dab186-7f74-4a47-a37a-71dff2b867b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.834625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dab186-7f74-4a47-a37a-71dff2b867b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.835040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dab186-7f74-4a47-a37a-71dff2b867b5 admin admin] PATH_INFO: `/v3/projects/902917ca8f7a4d9187801ab8dfbc9cd6/users/2175dfb75dac4973a52bc23f8c21b131/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.847954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 890/1766] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:19.848929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.853990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dab186-7f74-4a47-a37a-71dff2b867b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=902917ca8f7a4d9187801ab8dfbc9cd6, user_id=2175dfb75dac4973a52bc23f8c21b131, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.857281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dab186-7f74-4a47-a37a-71dff2b867b5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.868453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00a61-3c99-4c44-8fdd-636f60daa6f4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.877386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:19.879049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.879583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.880065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.881179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:19.897283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:19.901253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 877/1767] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:19 2022] PUT /identity/v3/projects/902917ca8f7a4d9187801ab8dfbc9cd6/users/2175dfb75dac4973a52bc23f8c21b131/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:19.902836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:19.903131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:19.903437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:19.931899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 891/1768] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:19.932969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:19.943651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:19.945117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7faf1-5430-47c3-9138-aa2bf91e35bc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:19.946058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:20.025587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:20.068494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 878/1769] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:47:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:20.069699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:20.071376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:20.095958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1fbce-4723-4aa9-984a-116b0021ac23 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:20.102145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:20.102820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.103107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.107608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.107757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473f33a-6cf9-444c-bc2f-f642f21515de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:20.107757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f33a-6cf9-444c-bc2f-f642f21515de admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.107757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f33a-6cf9-444c-bc2f-f642f21515de admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.107757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473f33a-6cf9-444c-bc2f-f642f21515de admin admin] PATH_INFO: `/v3/projects/e6202323520e4afc982a1eb65622b4e1/users/1b600127d3e44ee0b1b160e2e7363203/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.109238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473f33a-6cf9-444c-bc2f-f642f21515de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6202323520e4afc982a1eb65622b4e1, user_id=1b600127d3e44ee0b1b160e2e7363203, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:20.112579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3473f33a-6cf9-444c-bc2f-f642f21515de admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:20.136117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 892/1770] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:19 2022] PUT /identity/v3/projects/e6202323520e4afc982a1eb65622b4e1/users/1b600127d3e44ee0b1b160e2e7363203/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:20.138756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:20.141047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:20.148059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.148353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.148636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.171141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 879/1771] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:20.174439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:20.197372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:20.197747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64dd388-b253-4ece-94b3-752b40d3c825 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:20.277677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] MFA Rules not processed for user `2175dfb75dac4973a52bc23f8c21b131`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:20.278935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:20.368111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a68303e-580b-4fd8-96f5-3b6091851a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:20.369035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68303e-580b-4fd8-96f5-3b6091851a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.375893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68303e-580b-4fd8-96f5-3b6091851a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.376259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68303e-580b-4fd8-96f5-3b6091851a81 admin admin] PATH_INFO: `/v3/projects/0682dfeacbf949e0b424f02f1fbe0f40/users/5a11f6fb74144991919e72852e5ffb8c/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.388072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68303e-580b-4fd8-96f5-3b6091851a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0682dfeacbf949e0b424f02f1fbe0f40, user_id=5a11f6fb74144991919e72852e5ffb8c, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:20.402410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a68303e-580b-4fd8-96f5-3b6091851a81 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:20.443881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 880/1772] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:20 2022] PUT /identity/v3/projects/0682dfeacbf949e0b424f02f1fbe0f40/users/5a11f6fb74144991919e72852e5ffb8c/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:20.446833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01bab4-908b-4dd8-99e3-8effaa33bed1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.447174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01bab4-908b-4dd8-99e3-8effaa33bed1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.447849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01bab4-908b-4dd8-99e3-8effaa33bed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.529767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 893/1773] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:20.531087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:20.537233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:20.556454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9d01bab4-908b-4dd8-99e3-8effaa33bed1 None None] MFA Rules not processed for user `1b600127d3e44ee0b1b160e2e7363203`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:20.557698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9d01bab4-908b-4dd8-99e3-8effaa33bed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:20.663207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18492d32-521a-487e-bf64-a33e75a457a0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:20.690387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 881/1774] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:20.693173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.707398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.707916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.771277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] MFA Rules not processed for user `5a11f6fb74144991919e72852e5ffb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:20.772629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:20.775084 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:20.777380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.777720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.778064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.790083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:20.791661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:20.816242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 894/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:20.817105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:20.893913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:20.914859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3dc7dc-095e-45ad-9894-c7165b5929f9 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:20.915554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:20.928931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:20.930749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:20.931086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:20.931787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:20.936084 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:20.938045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:20.976325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 882/1776] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:20.977387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:20.981597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.000463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 895/1777] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:20 2022] POST /identity/v3/projects => generated 369 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:21.001354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.005140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.088460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b0d20-9044-4dea-8d7b-f8fd289e812b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.100764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305ce8f-eb4e-4264-98f5-8abc22a8b99c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.106341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.107846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.108463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.108921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] PATH_INFO: `/v3/projects/836139145b03448d92a04bd8d25060dc` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.110587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=836139145b03448d92a04bd8d25060dc)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.113228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.191246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.192404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.192866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.193448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.230114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836139145b03448d92a04bd8d25060dc', 'request_id': 'req-e5c561e5-448c-41c1-b92c-ada653f6eecc'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:21.238525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836139145b03448d92a04bd8d25060dc', 'request_id': 'req-e5c561e5-448c-41c1-b92c-ada653f6eecc'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:21.249991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836139145b03448d92a04bd8d25060dc', 'request_id': 'req-e5c561e5-448c-41c1-b92c-ada653f6eecc'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:21.275844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] The token cache is being invalidate because project 836139145b03448d92a04bd8d25060dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:21.276414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:21.277494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:21.283559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 896/1778] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:21 2022] DELETE /identity/v3/projects/836139145b03448d92a04bd8d25060dc => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:21.284829 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.287307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.325577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.329810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.357528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 883/1779] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:21.358682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.391177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c561e5-448c-41c1-b92c-ada653f6eecc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.400125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.400125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.400125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.400125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.400491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.417941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57668f9c-b8fd-4d7b-b96c-dbabc87c2f18 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.444425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:21.539557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:21.568834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.569727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.570523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.571197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.572121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.574628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.599275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.600860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5538a-2754-4df9-af40-bb14d4ec0065 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.619759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 897/1780] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:21.620744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937a023-6ef0-474a-839f-72e5df93a096 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.621029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937a023-6ef0-474a-839f-72e5df93a096 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.624319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 884/1781] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:21 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:21.625489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937a023-6ef0-474a-839f-72e5df93a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.626988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.630095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.655631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c57f5-e5dd-4dd5-b7ed-95bdc2ef5495 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.665856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.666429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c937a023-6ef0-474a-839f-72e5df93a096 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:21.666842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.667296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.667539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.667753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c937a023-6ef0-474a-839f-72e5df93a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.669067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.671496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.713483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 898/1782] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:21.729981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.730293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.736908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.754823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 885/1783] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:21.755879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.774685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40879cf7-c34a-454e-a7b4-058301766035 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.791058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:21.791345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.793725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.794189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:21.795747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.796185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] PATH_INFO: `/v3/projects/76f5aa6adeef42ef8a90b711f75f5696/users/52b30fc9a35c46939f1f20707015aca0/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.814618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 899/1784] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:21.819757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.866194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c29c0-ef59-4c80-a242-81f8a85be409 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:21.884733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:21.885745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:21.886213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:21.886577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:21.891601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:21.892554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.898828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.907620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f5aa6adeef42ef8a90b711f75f5696, user_id=52b30fc9a35c46939f1f20707015aca0, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:21.920339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:21.938448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 900/1785] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:21.942434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.980431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 886/1786] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:21 2022] PUT /identity/v3/projects/76f5aa6adeef42ef8a90b711f75f5696/users/52b30fc9a35c46939f1f20707015aca0/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:21.981496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:21.992191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff197a-5db7-4dc4-8cf3-3dd53263982f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.138793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a908fd8-a53d-48cc-92f9-cdcaa8671efb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.144815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.145958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.146258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.146597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.147293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.149427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.161479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.162197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.178152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.178650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.179706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.182803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 887/1787] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:22.184784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.188305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.209356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91363712-bfd8-44c7-879d-b5b543115697 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.220323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3265b-75ae-483f-905a-d3fc36e92f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.221980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3265b-75ae-483f-905a-d3fc36e92f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.222776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3265b-75ae-483f-905a-d3fc36e92f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.223697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3265b-75ae-483f-905a-d3fc36e92f0f admin admin] PATH_INFO: `/v3/projects/76f5aa6adeef42ef8a90b711f75f5696/users/52b30fc9a35c46939f1f20707015aca0/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.226510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3265b-75ae-483f-905a-d3fc36e92f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f5aa6adeef42ef8a90b711f75f5696, user_id=52b30fc9a35c46939f1f20707015aca0, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.229937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3265b-75ae-483f-905a-d3fc36e92f0f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.244668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 901/1788] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:21 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:22.245567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.248432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 888/1789] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:22 2022] PUT /identity/v3/projects/76f5aa6adeef42ef8a90b711f75f5696/users/52b30fc9a35c46939f1f20707015aca0/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:22.261514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff44a9-b605-4764-be9f-c68282bf6caf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.261809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff44a9-b605-4764-be9f-c68282bf6caf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.262217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff44a9-b605-4764-be9f-c68282bf6caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.309048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b5ff44a9-b605-4764-be9f-c68282bf6caf None None] MFA Rules not processed for user `52b30fc9a35c46939f1f20707015aca0`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:22.310343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b5ff44a9-b605-4764-be9f-c68282bf6caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.420240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea0796-4fbc-4264-b5b6-f0a9ae9ba5d9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.436273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.436975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.437264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.437545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.438249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.443576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.445661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 889/1790] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:22.449349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.449890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.450365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.478623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:22.480669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.486684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:22.494831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 902/1791] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:22 2022] POST /identity/v3/users => generated 288 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:22.500339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.507574 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.541327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc943a-75db-493b-aba6-3a2534c8a4ee admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.558118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.559355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.559638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.560079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] PATH_INFO: `/v3/users/58d270e9688a4552afe883fdf2f3522e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.563173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d270e9688a4552afe883fdf2f3522e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.570160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.571008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:22.589311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 890/1792] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:47:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:22.591854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.609696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257e79a-bd6b-4062-94a7-52379a131677 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.627412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.628244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.628537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.628991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.629582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.631498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.671797 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 891/1793] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:22.672742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.674874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.701890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d270e9688a4552afe883fdf2f3522e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.730853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d270e9688a4552afe883fdf2f3522e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.748034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d270e9688a4552afe883fdf2f3522e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.749021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d270e9688a4552afe883fdf2f3522e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.750441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d270e9688a4552afe883fdf2f3522e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.771336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce6867-01f8-432d-8af5-71d99919dada admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.776364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 903/1794] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:22 2022] DELETE /identity/v3/users/58d270e9688a4552afe883fdf2f3522e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:22.777308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.778705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.780174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.781206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.781697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.782319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.785134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.798499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.800521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.816495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 892/1795] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:22.817858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.819826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.843262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefca193-93e0-4a02-90b0-3f3f5e1ddada service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.852211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.853327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.854076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5e524-663c-43f5-bf95-3621d40b45c1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:22.854318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.855427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] PATH_INFO: `/v3/users/1301d79cdb5749a4afcb30eaf677f834` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.856894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1301d79cdb5749a4afcb30eaf677f834)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.859548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:22.860438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:22.860591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.860721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:22.861175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:22.862367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:22.864292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:22.885108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 904/1796] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:22.886153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:22.888964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:22.938593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1301d79cdb5749a4afcb30eaf677f834'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.946560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1301d79cdb5749a4afcb30eaf677f834'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.985401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1301d79cdb5749a4afcb30eaf677f834'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:22.988204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1301d79cdb5749a4afcb30eaf677f834'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:23.032640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9186ab99-d5f0-4a36-b91b-3b6aeff8d928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1301d79cdb5749a4afcb30eaf677f834'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:23.050525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323b266-3cf7-40fc-9281-efb301a86eb1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:23.062053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:23.063045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:23.064952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:23.066645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:23.069880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 893/1797] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:22 2022] DELETE /identity/v3/users/1301d79cdb5749a4afcb30eaf677f834 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:23.072195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.080749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339561-bbdc-4123-a8e9-e12664d465ef None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:23.080749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339561-bbdc-4123-a8e9-e12664d465ef None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:23.084285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339561-bbdc-4123-a8e9-e12664d465ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:23.126608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:23.150525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1d339561-bbdc-4123-a8e9-e12664d465ef None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:23.152477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1d339561-bbdc-4123-a8e9-e12664d465ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.181104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:23.236939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:23.239723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:23.260208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 905/1798] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:47:23.263268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:23.268868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.308510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce6422-c44c-4832-98b5-8ca2545a8634 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:23.331657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 894/1799] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:23.333148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8be4-3003-41a4-be29-886144cab852 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:23.335878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8be4-3003-41a4-be29-886144cab852 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:23.336208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c8be4-3003-41a4-be29-886144cab852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:23.390442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5d2c8be4-3003-41a4-be29-886144cab852 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:23.397382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5d2c8be4-3003-41a4-be29-886144cab852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.423226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 895/1800] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:23.452657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:23.461522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:23.461816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:23.462102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] PATH_INFO: `/v3/projects/0691d2822d29455da8338c223504ffc9/users/1a8650e9c303495b8b279fded5caa61d/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:23.497334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0691d2822d29455da8338c223504ffc9, user_id=1a8650e9c303495b8b279fded5caa61d, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:23.506388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:23.534095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 906/1801] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:23 2022] PUT /identity/v3/projects/0691d2822d29455da8338c223504ffc9/users/1a8650e9c303495b8b279fded5caa61d/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:23.545067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:23.545416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:23.545780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:23.586222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] MFA Rules not processed for user `1a8650e9c303495b8b279fded5caa61d`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:23.587702 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.723359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:23.723889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.789431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 896/1802] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:23.790351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:23.801532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:23.985984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b3d777-901c-4d20-90d2-410c051c8ad4 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:23.995918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:23.999089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:23.999089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:24.000298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:24.029390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16057-d4d0-4fbb-9d45-db3708ae0f18 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:24.041350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a0a59-52c0-44e4-9cee-8c7987097bbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:24.044857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a0a59-52c0-44e4-9cee-8c7987097bbe service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:24.049034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a0a59-52c0-44e4-9cee-8c7987097bbe service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:24.050062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a0a59-52c0-44e4-9cee-8c7987097bbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:24.120718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:24.147303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:24.154394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:24.210350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 907/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:24.217023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:24.221177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:24.263557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:24.288606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a0a59-52c0-44e4-9cee-8c7987097bbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:24.290464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75a0a59-52c0-44e4-9cee-8c7987097bbe service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:24.319340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 897/1804] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:24.387948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3493af2-588d-4152-bfe5-697b7026395b service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:24.405230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:24.405977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:24.406283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:24.406692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:24.427147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:24.433430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:24.449528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 908/1805] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:25.783737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:25.784639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:25.785061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:25.835896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:25.837528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:25.857259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 898/1806] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 6 13:47:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:25.940572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:25.951494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee7416-9494-4dbd-b011-b00759c0aea5 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:25.972532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:25.973242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:25.973563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:25.973884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:25.992145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:25.993862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:26.013775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 909/1807] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:26.206872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:26.220562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:26.285791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a621e69-1eb0-4cbb-99d3-b7cff5fd6a84 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:26.288189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:26.289631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:26.296038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:26.296937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:26.297220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:26.297492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] PATH_INFO: `/v3/users/2175dfb75dac4973a52bc23f8c21b131` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:26.338230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2175dfb75dac4973a52bc23f8c21b131)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:26.340657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:26.356549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400e8b2-6c36-4abf-b325-174dfd126191 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:26.377793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:26.378977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:26.379377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:26.379856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] PATH_INFO: `/v3/projects/e76cd0f715904af995e1be6d2cc82e7e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:26.385359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76cd0f715904af995e1be6d2cc82e7e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:26.394824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:26.527039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2175dfb75dac4973a52bc23f8c21b131'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.528325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2175dfb75dac4973a52bc23f8c21b131'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.562927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2175dfb75dac4973a52bc23f8c21b131'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.564488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2175dfb75dac4973a52bc23f8c21b131'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.589676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76cd0f715904af995e1be6d2cc82e7e', 'request_id': 'req-809b6a6b-331a-44ce-abb2-cdf057407ecf'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.606716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76cd0f715904af995e1be6d2cc82e7e', 'request_id': 'req-809b6a6b-331a-44ce-abb2-cdf057407ecf'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.616642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8565e57a-ba53-4b12-943d-bf7df2f05c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2175dfb75dac4973a52bc23f8c21b131'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.629545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76cd0f715904af995e1be6d2cc82e7e', 'request_id': 'req-809b6a6b-331a-44ce-abb2-cdf057407ecf'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.657747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] The token cache is being invalidate because project e76cd0f715904af995e1be6d2cc82e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:26.658529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.660168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:26.669176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 910/1808] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:26 2022] DELETE /identity/v3/projects/e76cd0f715904af995e1be6d2cc82e7e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:26.673052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 899/1809] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:26 2022] DELETE /identity/v3/users/2175dfb75dac4973a52bc23f8c21b131 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:26.675189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:26.678493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757406c8-507d-4b9d-ac98-af518080998b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:26.679428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757406c8-507d-4b9d-ac98-af518080998b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:26.680366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757406c8-507d-4b9d-ac98-af518080998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:26.681725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:26.733881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-757406c8-507d-4b9d-ac98-af518080998b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:26.736252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-757406c8-507d-4b9d-ac98-af518080998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:26.856129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 900/1810] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:26.857122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757406c8-507d-4b9d-ac98-af518080998b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:26.859672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-757406c8-507d-4b9d-ac98-af518080998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:26.893961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b6a6b-331a-44ce-abb2-cdf057407ecf admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:26.894092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757406c8-507d-4b9d-ac98-af518080998b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:26.910853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:26.913582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:26.914294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:26.914726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:26.915243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] PATH_INFO: `/v3/projects/ef28d69451e54f0eb36917a27731feef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:26.918274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef28d69451e54f0eb36917a27731feef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:26.921214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:26.922576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:26.922576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] PATH_INFO: `/v3/users/5a11f6fb74144991919e72852e5ffb8c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:26.922764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:26.926441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a11f6fb74144991919e72852e5ffb8c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:26.935533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:26.952474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:27.055264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a11f6fb74144991919e72852e5ffb8c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.086143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a11f6fb74144991919e72852e5ffb8c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.101376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a11f6fb74144991919e72852e5ffb8c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.103085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a11f6fb74144991919e72852e5ffb8c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.107107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a11f6fb74144991919e72852e5ffb8c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.140689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 911/1811] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:26 2022] DELETE /identity/v3/users/5a11f6fb74144991919e72852e5ffb8c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:27.144664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:27.153032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:27.158007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef28d69451e54f0eb36917a27731feef', 'request_id': 'req-a5490e5d-dc23-4ba2-b336-08fbb7558b58'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.166840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:27.193328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef28d69451e54f0eb36917a27731feef', 'request_id': 'req-a5490e5d-dc23-4ba2-b336-08fbb7558b58'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.223563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef28d69451e54f0eb36917a27731feef', 'request_id': 'req-a5490e5d-dc23-4ba2-b336-08fbb7558b58'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.271238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] The token cache is being invalidate because project ef28d69451e54f0eb36917a27731feef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:27.271545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.272932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.276761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 901/1812] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:26 2022] DELETE /identity/v3/projects/ef28d69451e54f0eb36917a27731feef => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:27.280222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:27.282561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:27.307639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0222e7-22d9-4d5b-af80-c4b99320a016 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:27.325587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:27.328421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:27.328421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:27.328954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:27.346240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:27.490326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5490e5d-dc23-4ba2-b336-08fbb7558b58 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:27.542296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:27.543819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:27.574186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 912/1813] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:27.670427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:27.671349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:27.676944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:27.678406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] PATH_INFO: `/v3/users/1b600127d3e44ee0b1b160e2e7363203` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:27.682554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b600127d3e44ee0b1b160e2e7363203)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:27.687181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:27.810151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b600127d3e44ee0b1b160e2e7363203'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.812335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b600127d3e44ee0b1b160e2e7363203'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.835874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b600127d3e44ee0b1b160e2e7363203'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.838004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b600127d3e44ee0b1b160e2e7363203'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.880419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cacb696b-3f6f-4d60-b2af-68e3c00d312c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b600127d3e44ee0b1b160e2e7363203'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:27.920908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 902/1814] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:27 2022] DELETE /identity/v3/users/1b600127d3e44ee0b1b160e2e7363203 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:29.130754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:29.132548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:29.152248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e24801-34f4-4aa6-8129-038736f8b6ee service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:29.267203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:29.362335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:29.363530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:29.365701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:29.366191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] PATH_INFO: `/v3/projects/0682dfeacbf949e0b424f02f1fbe0f40` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:29.370559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0682dfeacbf949e0b424f02f1fbe0f40)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:29.376749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:29.480832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489d960-f8ff-467c-a1ff-6b4d4454b78d None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:29.481906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489d960-f8ff-467c-a1ff-6b4d4454b78d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:29.482462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489d960-f8ff-467c-a1ff-6b4d4454b78d None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:29.484518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 903/1815] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:47:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:29.519203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:29.520166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:29.520968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:29.586436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0682dfeacbf949e0b424f02f1fbe0f40', 'request_id': 'req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:29.592782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:29.597066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0682dfeacbf949e0b424f02f1fbe0f40', 'request_id': 'req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:29.613144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0682dfeacbf949e0b424f02f1fbe0f40', 'request_id': 'req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:29.620909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:29.626941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:29.631962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] The token cache is being invalidate because project 0682dfeacbf949e0b424f02f1fbe0f40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:29.632268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:29.633147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c5809df3-ebc8-4771-9dc9-3a9c592e20f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:29.646991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 913/1816] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:29 2022] DELETE /identity/v3/projects/0682dfeacbf949e0b424f02f1fbe0f40 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:29.648894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3df12-e1f5-4ab4-8bd7-3c8172635d00 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:29.649228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3df12-e1f5-4ab4-8bd7-3c8172635d00 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:29.649537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3df12-e1f5-4ab4-8bd7-3c8172635d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:29.713080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b1a3df12-e1f5-4ab4-8bd7-3c8172635d00 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:29.714501 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b1a3df12-e1f5-4ab4-8bd7-3c8172635d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:29.881570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 914/1817] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:29.881570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941f1d-eaf7-4612-a242-aa0e151a5e75 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:29.881570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941f1d-eaf7-4612-a242-aa0e151a5e75 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:29.881570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a941f1d-eaf7-4612-a242-aa0e151a5e75 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:29.881570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 915/1818] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:47:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:29.885314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:29.885939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:29.886224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:29.926570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:29.940954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 904/1819] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:29.944832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:29.959830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 916/1820] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:29.963666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:29.980417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5483e8de-0fa3-46e9-8026-fdc04fdd96cb None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.001726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.003401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.003978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.005135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.006460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:30.006947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.008809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.038086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 905/1821] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:30.042404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.061726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9b0b1-b8c9-4fd1-b6a3-5ce74c0ee17b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.092190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ba34-d002-4577-808f-06c46bacfb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.093211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ba34-d002-4577-808f-06c46bacfb28 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.094631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ba34-d002-4577-808f-06c46bacfb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.095417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ba34-d002-4577-808f-06c46bacfb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.096606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ba34-d002-4577-808f-06c46bacfb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.109559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ba34-d002-4577-808f-06c46bacfb28 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.169083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 917/1822] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:30 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:30.172580 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.185409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.185774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.188559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33fa56f-955f-43db-980c-6b29bed98cbf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.190578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.275045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:30.276733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.370142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.372598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.373336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.373799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.377416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.380144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:30.384601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.471560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 918/1823] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:47:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:30.473056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.475513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.479981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 906/1824] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:30 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:30.481067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.484726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.513550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266779d9-b9d5-47b1-abd5-70895798c0d1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.522756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e7dcd-f588-4a24-b96b-43fbe08bb826 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.532415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.533974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.534376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.534629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] PATH_INFO: `/v3/projects/902917ca8f7a4d9187801ab8dfbc9cd6` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.536324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902917ca8f7a4d9187801ab8dfbc9cd6)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.537670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.538939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.539632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.540372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.545300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.552977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.565732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.582380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 919/1825] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:30.583585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.603596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21471f-f6c0-4219-83f8-f84145bc1df5 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.610284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.611773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.612753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.613350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.614375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.617720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.633082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 920/1826] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:30.634286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.637383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.657983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5a8a7-43ae-4b67-81e1-7372f0be1549 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.690260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902917ca8f7a4d9187801ab8dfbc9cd6', 'request_id': 'req-c7dfa534-525a-4088-8d30-8a1f728f0670'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:30.701585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902917ca8f7a4d9187801ab8dfbc9cd6', 'request_id': 'req-c7dfa534-525a-4088-8d30-8a1f728f0670'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:30.715077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902917ca8f7a4d9187801ab8dfbc9cd6', 'request_id': 'req-c7dfa534-525a-4088-8d30-8a1f728f0670'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:30.728623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:30.736353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] The token cache is being invalidate because project 902917ca8f7a4d9187801ab8dfbc9cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:30.737077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:30.741131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:30.744169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 907/1827] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:30 2022] DELETE /identity/v3/projects/902917ca8f7a4d9187801ab8dfbc9cd6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:30.749482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.755953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.828096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.831486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.831791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.832035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.838916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.855141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.856925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.872407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 921/1828] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:30.873241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.875266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:30.910136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfa534-525a-4088-8d30-8a1f728f0670 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.919762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.920918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.922689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.924117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:30.925543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:30.930297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:30.948668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 908/1829] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:30.952389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:30.970532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291853cb-439f-4b1a-9f95-e02ceff01920 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:30.982896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dab116-9c74-4f6d-a138-020bd152246e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:30.984448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dab116-9c74-4f6d-a138-020bd152246e admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:30.984865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dab116-9c74-4f6d-a138-020bd152246e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:30.985729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dab116-9c74-4f6d-a138-020bd152246e admin admin] PATH_INFO: `/v3/projects/09a680ed769245b79ecd7790336b9810/users/23d303857ae64f5c8b4b6ad9bde59c9f/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:31.004174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60fdc6a-9878-4274-8355-6cab42926af8 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:31.010029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:31.011313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:31.011744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:31.012048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] PATH_INFO: `/v3/users/52b30fc9a35c46939f1f20707015aca0` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:31.013513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52b30fc9a35c46939f1f20707015aca0)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:31.015824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:31.042447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dab116-9c74-4f6d-a138-020bd152246e admin admin] RBAC: Authorizing `identity:create_grant(project_id=09a680ed769245b79ecd7790336b9810, user_id=23d303857ae64f5c8b4b6ad9bde59c9f, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:31.050656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dab116-9c74-4f6d-a138-020bd152246e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:31.084372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 909/1830] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:30 2022] PUT /identity/v3/projects/09a680ed769245b79ecd7790336b9810/users/23d303857ae64f5c8b4b6ad9bde59c9f/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:31.095805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:31.096851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:31.097305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:31.151854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:31.193958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] MFA Rules not processed for user `23d303857ae64f5c8b4b6ad9bde59c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:31.197178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:31.207682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52b30fc9a35c46939f1f20707015aca0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.235714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52b30fc9a35c46939f1f20707015aca0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.253967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52b30fc9a35c46939f1f20707015aca0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.255011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52b30fc9a35c46939f1f20707015aca0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.255856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52b30fc9a35c46939f1f20707015aca0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.279005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 922/1831] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:30 2022] DELETE /identity/v3/users/52b30fc9a35c46939f1f20707015aca0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:31.386452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:31.388478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:31.415405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 910/1832] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:31.420147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:31.422078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:31.614147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce074c02-64a6-4e22-b061-8989abf771bd None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:31.636502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:31.637242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:31.639982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:31.640195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:31.640924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:31.650059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b4ad0-cb58-4d17-9867-6352b3872235 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:31.655548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:31.672410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:31.683809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:31.684716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:31.690565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:31.690898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] PATH_INFO: `/v3/projects/e6202323520e4afc982a1eb65622b4e1` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:31.698831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6202323520e4afc982a1eb65622b4e1)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:31.712769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:31.760938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 911/1833] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:31 2022] POST /identity/v3/projects => generated 387 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:31.763164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:31.920458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c305f0-52ba-4e2f-9401-9041a23638d5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:31.926042 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6202323520e4afc982a1eb65622b4e1', 'request_id': 'req-429be552-707c-466c-911b-fcacd0a4a5f7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.936812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6202323520e4afc982a1eb65622b4e1', 'request_id': 'req-429be552-707c-466c-911b-fcacd0a4a5f7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.951569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6202323520e4afc982a1eb65622b4e1', 'request_id': 'req-429be552-707c-466c-911b-fcacd0a4a5f7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.984797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] The token cache is being invalidate because project e6202323520e4afc982a1eb65622b4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:31.985251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.986469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-429be552-707c-466c-911b-fcacd0a4a5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:31.989603 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 923/1834] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:31 2022] DELETE /identity/v3/projects/e6202323520e4afc982a1eb65622b4e1 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:31.998061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a588-34ae-4a4b-ae02-91bc627611b7 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:31.998751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a588-34ae-4a4b-ae02-91bc627611b7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.000387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5926a588-34ae-4a4b-ae02-91bc627611b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.081724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5926a588-34ae-4a4b-ae02-91bc627611b7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:32.087694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5926a588-34ae-4a4b-ae02-91bc627611b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:32.110960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.114999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.115143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.116385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.117139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:32.125047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 924/1835] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:32.132652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.133028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.133361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.143457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:32.184472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:32.185771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:32.196952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 912/1836] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:31 2022] POST /identity/v3/users => generated 300 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:32.202068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:32.204991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:32.237760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 925/1837] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:32.241857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:32.263665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63466317-b78a-4a31-a96c-883e66b16657 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:32.270344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15289e7-0fb3-4990-b5c3-15e962918903 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:32.291216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.292168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.292478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.292751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.295912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.299766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:32.300908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:32.303591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:32.307781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.308102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.308393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.309336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:32.310813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:32.323382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 926/1838] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:32.327572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:32.360790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 913/1839] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:32.365599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:32.371705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf8413-6b1f-49f6-a287-9dcecdfa165d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:32.386953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:32.395686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.398511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.399298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.401332 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.425852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:32.434848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b9b1d-4489-4e83-aa44-f0b600bd3933 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:32.434975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:32.451869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:32.489651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.490560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.490853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.491134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] PATH_INFO: `/v3/projects/76f5aa6adeef42ef8a90b711f75f5696` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.508878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f5aa6adeef42ef8a90b711f75f5696)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:32.511407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:32.589341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 927/1840] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:32 2022] POST /identity/v3/projects => generated 365 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:32.594228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:32.648949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f5aa6adeef42ef8a90b711f75f5696', 'request_id': 'req-b199bfa3-12ae-40a2-a5fe-36374ce26727'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:32.673975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f5aa6adeef42ef8a90b711f75f5696', 'request_id': 'req-b199bfa3-12ae-40a2-a5fe-36374ce26727'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:32.694477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f5aa6adeef42ef8a90b711f75f5696', 'request_id': 'req-b199bfa3-12ae-40a2-a5fe-36374ce26727'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:32.700545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:32.718997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] The token cache is being invalidate because project 76f5aa6adeef42ef8a90b711f75f5696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:32.719346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:32.723939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:32.727676 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 914/1841] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:32 2022] DELETE /identity/v3/projects/76f5aa6adeef42ef8a90b711f75f5696 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:32.730401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:32.731859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:32.806893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7476654-acdb-4bc8-9ece-3c7bec026562 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:32.975343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.976590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.976881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.977163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] PATH_INFO: `/v3/projects/e6f723e4cb6c483bbba0dd0bff541203/users/578c74958d3b425dbdbdd3d899a48f9a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.981387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199bfa3-12ae-40a2-a5fe-36374ce26727 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:32.990657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d158c595-89ff-4924-821f-44fb9bf79441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:32.991915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158c595-89ff-4924-821f-44fb9bf79441 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:32.992345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158c595-89ff-4924-821f-44fb9bf79441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:32.992856 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d158c595-89ff-4924-821f-44fb9bf79441 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:32.993772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158c595-89ff-4924-821f-44fb9bf79441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:32.996221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d158c595-89ff-4924-821f-44fb9bf79441 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.024637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f723e4cb6c483bbba0dd0bff541203, user_id=578c74958d3b425dbdbdd3d899a48f9a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.034505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.048714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 915/1842] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:32 2022] POST /identity/v3/users => generated 283 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:33.056046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.059115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.059602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.082338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 928/1843] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:32 2022] PUT /identity/v3/projects/e6f723e4cb6c483bbba0dd0bff541203/users/578c74958d3b425dbdbdd3d899a48f9a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:33.086200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:33.111287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:33.121320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:33.258652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ccbb-32de-450f-9537-24e152711c7e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:33.264103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:33.264777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.265070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.265354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.266292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.268444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.281592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 929/1844] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:33.286701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:33.288619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:33.323995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50e0e8-6daf-4f12-94bb-bd88f34e0804 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:33.353041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bcdeb1-efee-4eb3-9012-9821d4544572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:33.353831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcdeb1-efee-4eb3-9012-9821d4544572 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.354007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcdeb1-efee-4eb3-9012-9821d4544572 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.354291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bcdeb1-efee-4eb3-9012-9821d4544572 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.355039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcdeb1-efee-4eb3-9012-9821d4544572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.358732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bcdeb1-efee-4eb3-9012-9821d4544572 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.379531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 916/1845] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:33.380562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:33.395695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 930/1846] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:33.399640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.400103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.400941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.402849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3563a-497d-4e91-9492-b391219822a0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:33.419859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:33.422349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:33.424185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.424894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.425266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.425918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.429789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.465138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 917/1847] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:33.466612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:33.470370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:33.473344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:33.488164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 931/1848] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:33.493826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:33.497581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69345fb1-4743-468f-8973-1447108e5414 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:33.504458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:33.505509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.505898 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.508457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] PATH_INFO: `/v3/projects/e6f723e4cb6c483bbba0dd0bff541203/users/578c74958d3b425dbdbdd3d899a48f9a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.508457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6f723e4cb6c483bbba0dd0bff541203, user_id=578c74958d3b425dbdbdd3d899a48f9a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.512368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.517102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3877a6-6fe3-4491-9679-3c95b7b0579f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:33.526161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 918/1849] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:33 2022] PUT /identity/v3/projects/e6f723e4cb6c483bbba0dd0bff541203/users/578c74958d3b425dbdbdd3d899a48f9a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:33.527129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:33.617594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e724f0-82d6-4169-b1fa-d0d4f661cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:33.619121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e724f0-82d6-4169-b1fa-d0d4f661cc49 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.620757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e724f0-82d6-4169-b1fa-d0d4f661cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.621178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e724f0-82d6-4169-b1fa-d0d4f661cc49 admin admin] PATH_INFO: `/v3/projects/b255cba3794e4f46b306dec6e00e3c50/users/358dafb2e91c4f188ac471ce3cb75dba/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.652252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19245620-8792-40fd-bc37-fc198df81dd8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:33.661082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e724f0-82d6-4169-b1fa-d0d4f661cc49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b255cba3794e4f46b306dec6e00e3c50, user_id=358dafb2e91c4f188ac471ce3cb75dba, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.665026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e724f0-82d6-4169-b1fa-d0d4f661cc49 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.668394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:33.670525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.670823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.671136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.672750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:33.673194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:33.685555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 932/1850] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:33 2022] PUT /identity/v3/projects/b255cba3794e4f46b306dec6e00e3c50/users/358dafb2e91c4f188ac471ce3cb75dba/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:33.687409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.687409 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.687618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.702796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc014e4f-d3b3-496c-a37b-58314979aa52 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:33.706588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:33.731636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] MFA Rules not processed for user `578c74958d3b425dbdbdd3d899a48f9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:33.733155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:33.738682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 919/1851] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:33.773477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:33.775170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:33.777347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:33.833990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] MFA Rules not processed for user `358dafb2e91c4f188ac471ce3cb75dba`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:33.835342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:33.867625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 933/1852] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:33.868782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.042820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 920/1853] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:34.043776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.047650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:34.130069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d80e9-7c50-44e1-bea3-78ea59bb932b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.154147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.154402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.154681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.154964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.155719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.157656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.185959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:34.224150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963cabe-0111-49c0-b8c8-8bfb26eeb72d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.233408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 934/1854] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:33 2022] POST /identity/v3/projects => generated 387 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:34.234379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.235150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.235560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.236441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.237584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.261048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.262664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.293617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 921/1855] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:34.296151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.316830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdc669b-7bd2-4f8f-92a2-6c6286b4da9b service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.412372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78cac2-8ecd-4200-a7ee-23a28f07c502 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.419153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.419870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.420154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.421993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.424333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.429520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.496425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 935/1856] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:34 2022] POST /identity/v3/projects => generated 365 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:34.500304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.516698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.520169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.520807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.522412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.523361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.527534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.601439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 922/1857] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:34 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:34.601439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.617703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34bd90f-eaa2-46e4-8a58-19ba7acbe4d5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.635602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:34.709235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681cc06-2bea-4b34-9c26-ce6aa991696e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.715279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.716125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.716504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.716874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.718141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.720178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.722492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.723967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.725423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.725710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.728661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.734647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.745612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 923/1858] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:34.750555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.782537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 936/1859] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:34 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:34.791759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.810073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169aeddb-f75b-4055-af7e-09e41dcd8e51 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.822795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a207cf-c925-47fe-9733-2518f5f283f0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.831457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.832755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.833487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.834108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.834312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.834666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.835082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.836775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.837256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.837721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.840923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.849491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.868411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 937/1860] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:34.869614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.883033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7c8f0-f0ce-4336-874f-d936ffdf8a0e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.888543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 924/1861] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:34.891669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:34.912517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:34.914096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:34.915697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:34.916369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] PATH_INFO: `/v3/projects/e3711f2ffdac47098c1c47fff6434517/users/20f99e1c23a443ef8c6c03fff2fba767/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:34.940116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386edc6-b1a7-4f7a-9f56-05b276eb882d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:34.948583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3711f2ffdac47098c1c47fff6434517, user_id=20f99e1c23a443ef8c6c03fff2fba767, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:34.951860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:34.975884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 938/1862] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:34 2022] PUT /identity/v3/projects/e3711f2ffdac47098c1c47fff6434517/users/20f99e1c23a443ef8c6c03fff2fba767/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:34.989542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:35.043476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:35.097862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a448c12-dc0b-4c8d-8aba-1979303998c9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:35.104339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:35.105442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.105976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.106510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.107541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:35.110146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:35.129311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 939/1863] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:35.131297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:35.145993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250aec33-01a5-4d08-b5c2-f3eacd257eb9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:35.153709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d7da7-bb73-4def-9d12-19e79ae8c31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:35.155644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7da7-bb73-4def-9d12-19e79ae8c31d admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.160180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7da7-bb73-4def-9d12-19e79ae8c31d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.160587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d7da7-bb73-4def-9d12-19e79ae8c31d admin admin] PATH_INFO: `/v3/projects/e3711f2ffdac47098c1c47fff6434517/users/20f99e1c23a443ef8c6c03fff2fba767/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.163154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d7da7-bb73-4def-9d12-19e79ae8c31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3711f2ffdac47098c1c47fff6434517, user_id=20f99e1c23a443ef8c6c03fff2fba767, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:35.193410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d7da7-bb73-4def-9d12-19e79ae8c31d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:35.196567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84886e9e-4323-485f-9712-6a6789b6cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:35.197838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84886e9e-4323-485f-9712-6a6789b6cfeb admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.198824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84886e9e-4323-485f-9712-6a6789b6cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.199672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84886e9e-4323-485f-9712-6a6789b6cfeb admin admin] PATH_INFO: `/v3/projects/e5751ecfb3a54530b087ac699335ab7a/users/1ab39a18f86c43fb8a83450ff4f16270/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.231421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 940/1864] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:35 2022] PUT /identity/v3/projects/e3711f2ffdac47098c1c47fff6434517/users/20f99e1c23a443ef8c6c03fff2fba767/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:35.239765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.241398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.242061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.247207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84886e9e-4323-485f-9712-6a6789b6cfeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5751ecfb3a54530b087ac699335ab7a, user_id=1ab39a18f86c43fb8a83450ff4f16270, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:35.251622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84886e9e-4323-485f-9712-6a6789b6cfeb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:35.295036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 925/1865] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:34 2022] PUT /identity/v3/projects/e5751ecfb3a54530b087ac699335ab7a/users/1ab39a18f86c43fb8a83450ff4f16270/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:35.309437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.309921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.310276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.361389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] MFA Rules not processed for user `1ab39a18f86c43fb8a83450ff4f16270`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:35.366092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:35.378564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] MFA Rules not processed for user `20f99e1c23a443ef8c6c03fff2fba767`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:35.381987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:35.660949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 926/1866] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:35.666179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:35.694060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 941/1867] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:35.702780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:35.789708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:35.843604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c85ec-73c6-4a2a-8684-3aeb696ade9b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:35.860458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:35.862590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.863338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.863793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.864737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:35.868944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:35.910605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2cf58f-cc21-414c-a776-1e808b380ffe None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:35.917132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:35.918212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:35.918613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:35.918985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:35.923474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 927/1868] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:35 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:35.925250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:35.942748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:35.945142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:35.963510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 942/1869] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:35.964386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:35.986301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033e6e3-8da1-4491-beda-a570cdf34fcd service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.048015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:36.066729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797225c-0482-4c81-aae3-969337454554 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.079776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.080184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.081375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.081720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.081822 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.082008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] PATH_INFO: `/v3/users/23d303857ae64f5c8b4b6ad9bde59c9f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.082922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.083262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23d303857ae64f5c8b4b6ad9bde59c9f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.083403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.084213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.086324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.086912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.118988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 943/1870] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:35 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:36.120425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.148911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23d303857ae64f5c8b4b6ad9bde59c9f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:36.150322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23d303857ae64f5c8b4b6ad9bde59c9f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:36.165883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23d303857ae64f5c8b4b6ad9bde59c9f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:36.166658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23d303857ae64f5c8b4b6ad9bde59c9f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:36.186117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23d303857ae64f5c8b4b6ad9bde59c9f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:36.200494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f37b0-a480-4be8-b7e5-fed9e406e74e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.204587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.205352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.205635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.205835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.207667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.209560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 928/1871] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:35 2022] DELETE /identity/v3/users/23d303857ae64f5c8b4b6ad9bde59c9f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:36.210666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.213599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.235555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:36.284488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.285988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed7bbc-be1c-42e6-8f37-6d5fdfa86a52 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.286276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7847ab-c60a-4a16-b68f-6ad4058eace5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.291642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.292722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.293007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.293279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.294061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.295721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.297470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 944/1872] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:36.300345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.300633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.300913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.311679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 929/1873] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:36.317343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.321224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:36.322487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.329032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca405-7750-4efd-916b-4535a586f62d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.332312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 945/1874] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:36.343048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.344860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.345117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.346604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.347261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.347821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] PATH_INFO: `/v3/projects/cdcf0bba037949749c603512de6bdb58/users/d4a15741d13c4a0781b2e41a84873767/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.378461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcf0bba037949749c603512de6bdb58, user_id=d4a15741d13c4a0781b2e41a84873767, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.381928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.402786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 930/1875] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:36 2022] PUT /identity/v3/projects/cdcf0bba037949749c603512de6bdb58/users/d4a15741d13c4a0781b2e41a84873767/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:36.406863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.463793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64c557-6b90-4f2c-9a56-dc9129ab418e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.511443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc970a1-b88a-4f04-87b9-614a4e4f4b43 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.514394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:36.517431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.519115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.519506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.520603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.521520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.523601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.534990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 931/1876] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:36.538066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30a507-0df4-4b79-8a2a-5e1e5facec92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.538861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a507-0df4-4b79-8a2a-5e1e5facec92 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.539130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a507-0df4-4b79-8a2a-5e1e5facec92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.539423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30a507-0df4-4b79-8a2a-5e1e5facec92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.539554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.550442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a6bd71-25a0-467c-87e8-f7f6c87a388d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.550600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a507-0df4-4b79-8a2a-5e1e5facec92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.552098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30a507-0df4-4b79-8a2a-5e1e5facec92 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.555301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.556218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.556505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.556780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] PATH_INFO: `/v3/projects/cdcf0bba037949749c603512de6bdb58/users/d4a15741d13c4a0781b2e41a84873767/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.558762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcf0bba037949749c603512de6bdb58, user_id=d4a15741d13c4a0781b2e41a84873767, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.561431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.563040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 946/1877] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:36.578337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 932/1878] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:36 2022] PUT /identity/v3/projects/cdcf0bba037949749c603512de6bdb58/users/d4a15741d13c4a0781b2e41a84873767/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:36.585283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.585770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.586128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.618992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] MFA Rules not processed for user `d4a15741d13c4a0781b2e41a84873767`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:36.620261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.695010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 947/1879] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:36.706841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.708822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.779148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a595451-a590-485b-a12e-ff5a67031e44 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.785892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.786384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.786672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.786948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.797215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.798684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:36.809887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 933/1880] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:36.890588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.943243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:36.945239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:36.976278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:36.979226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c5b8a-0227-4fd1-8eb0-2835ea8064b7 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:36.984887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:36.985796 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:36.986065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:36.986345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] PATH_INFO: `/v3/users/1ab39a18f86c43fb8a83450ff4f16270` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:36.987828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab39a18f86c43fb8a83450ff4f16270)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:36.990067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:37.043282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a030c-52b6-4168-befc-21c3ab396c17 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:37.046496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab39a18f86c43fb8a83450ff4f16270'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.048426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:37.049967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:37.050322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:37.050607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] PATH_INFO: `/v3/projects/09a680ed769245b79ecd7790336b9810` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:37.052170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09a680ed769245b79ecd7790336b9810)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:37.054252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:37.060575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:37.061382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab39a18f86c43fb8a83450ff4f16270'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.072118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab39a18f86c43fb8a83450ff4f16270'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.072973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab39a18f86c43fb8a83450ff4f16270'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.074007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-1c0d1c0f-1df2-4b2e-9582-0a67818ccf25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab39a18f86c43fb8a83450ff4f16270'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.089346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 948/1881] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:36 2022] DELETE /identity/v3/users/1ab39a18f86c43fb8a83450ff4f16270 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:37.094031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:37.094335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:37.094623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:37.117487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:37.118773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:37.120217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09a680ed769245b79ecd7790336b9810', 'request_id': 'req-3078ed6c-3642-426e-85ac-883ebce7c8e1'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.127494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09a680ed769245b79ecd7790336b9810', 'request_id': 'req-3078ed6c-3642-426e-85ac-883ebce7c8e1'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.134958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09a680ed769245b79ecd7790336b9810', 'request_id': 'req-3078ed6c-3642-426e-85ac-883ebce7c8e1'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.150224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] The token cache is being invalidate because project 09a680ed769245b79ecd7790336b9810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:37.150540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.151463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.155417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 934/1882] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:36 2022] DELETE /identity/v3/projects/09a680ed769245b79ecd7790336b9810 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:37.159815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:37.166617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:37.193814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 949/1883] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:37.207505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:37.208894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:37.266591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078ed6c-3642-426e-85ac-883ebce7c8e1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:37.271613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:37.272504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:37.272794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:37.273273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] PATH_INFO: `/v3/users/578c74958d3b425dbdbdd3d899a48f9a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:37.274421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578c74958d3b425dbdbdd3d899a48f9a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:37.276733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:37.291607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da74150-0954-4be8-86d1-11ee7104cfd3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:37.297563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:37.298533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:37.298965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:37.300053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:37.311113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:37.312808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:37.325065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 950/1884] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:37.337640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578c74958d3b425dbdbdd3d899a48f9a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.339236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578c74958d3b425dbdbdd3d899a48f9a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.341048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:37.351684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578c74958d3b425dbdbdd3d899a48f9a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.353013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578c74958d3b425dbdbdd3d899a48f9a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.369504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578c74958d3b425dbdbdd3d899a48f9a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.391362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 935/1885] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:37 2022] DELETE /identity/v3/users/578c74958d3b425dbdbdd3d899a48f9a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:37.692509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:37.693990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:37.709554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3610d19-f04b-4627-85b1-57fc58ae0fe8 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:37.788678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:37.788678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:37.788678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:37.788678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] PATH_INFO: `/v3/projects/e5751ecfb3a54530b087ac699335ab7a` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:37.789458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5751ecfb3a54530b087ac699335ab7a)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:37.790072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:37.817765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:37.819066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:37.831895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:37.837333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690e491-93aa-46fb-8872-ac150c944774 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:37.862964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5751ecfb3a54530b087ac699335ab7a', 'request_id': 'req-75e9189e-c9e6-4669-b680-4e816d1e562d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.883994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5751ecfb3a54530b087ac699335ab7a', 'request_id': 'req-75e9189e-c9e6-4669-b680-4e816d1e562d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.898463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5751ecfb3a54530b087ac699335ab7a', 'request_id': 'req-75e9189e-c9e6-4669-b680-4e816d1e562d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.917594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] The token cache is being invalidate because project e5751ecfb3a54530b087ac699335ab7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:37.918002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.919605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:37.924144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 951/1886] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:37 2022] DELETE /identity/v3/projects/e5751ecfb3a54530b087ac699335ab7a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:37.927095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:37.929207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:38.008516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.009423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.009705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.010006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] PATH_INFO: `/v3/projects/e6f723e4cb6c483bbba0dd0bff541203` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.012548 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6f723e4cb6c483bbba0dd0bff541203)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.014572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.051282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e9189e-c9e6-4669-b680-4e816d1e562d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.056576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.057520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.057807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.058140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] PATH_INFO: `/v3/users/d4a15741d13c4a0781b2e41a84873767` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.059289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a15741d13c4a0781b2e41a84873767)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.061251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.074030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6f723e4cb6c483bbba0dd0bff541203', 'request_id': 'req-827a02b3-4ba8-49d5-b46e-50a37716dac4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.080379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6f723e4cb6c483bbba0dd0bff541203', 'request_id': 'req-827a02b3-4ba8-49d5-b46e-50a37716dac4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.086583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6f723e4cb6c483bbba0dd0bff541203', 'request_id': 'req-827a02b3-4ba8-49d5-b46e-50a37716dac4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.104665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] The token cache is being invalidate because project e6f723e4cb6c483bbba0dd0bff541203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:38.105013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.105862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-827a02b3-4ba8-49d5-b46e-50a37716dac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.110830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 936/1887] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:37 2022] DELETE /identity/v3/projects/e6f723e4cb6c483bbba0dd0bff541203 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:38.117918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.118310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.118708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.123339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a15741d13c4a0781b2e41a84873767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.142944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a15741d13c4a0781b2e41a84873767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.151835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a15741d13c4a0781b2e41a84873767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.152733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a15741d13c4a0781b2e41a84873767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.153496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-beecde53-713f-49fa-9dca-85ed3114e981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a15741d13c4a0781b2e41a84873767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:38.166525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:38.168689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:38.173949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 952/1888] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:37 2022] DELETE /identity/v3/users/d4a15741d13c4a0781b2e41a84873767 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:38.231688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:38.247950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 937/1889] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:38.256880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.257728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.258021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.280824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:38.282021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:38.295367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 953/1890] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:38.299949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:38.314631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e57eff-6a56-4921-aa77-479c358630fe None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.326149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.327836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.329065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.329065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.330824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:38.331512 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.333983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.357401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 938/1891] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:38.357612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:38.372433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a33be7-a0fc-473a-95d5-85771fa801ee None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.377263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.377975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.378431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.378715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.379494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.381406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.415967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 954/1892] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:38 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:38.417214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:38.429990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593d56-cf0f-485d-94e4-f145d0f6bf29 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.584644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.585504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.586563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.586858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.587623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.589573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.641612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 939/1893] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:38 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:38.645126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:38.654323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:38.663372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08c6ee-d8ec-4d02-8bde-c54b8f50f0be admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.673741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.679228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.679228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.679228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.679228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.679777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.717490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 955/1894] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:38.718838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:38.731251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9966e7-281c-492f-8b31-fd3d482b7fd4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.737298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de7e7d-7141-465e-9650-1bf65278b43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.738688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7e7d-7141-465e-9650-1bf65278b43c admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.739058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7e7d-7141-465e-9650-1bf65278b43c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.739444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7e7d-7141-465e-9650-1bf65278b43c admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.740317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de7e7d-7141-465e-9650-1bf65278b43c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.742127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de7e7d-7141-465e-9650-1bf65278b43c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.762300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 940/1895] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:38.766802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:38.780768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97328d4d-d5fa-42a1-84f3-552853a3406d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:38.792966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:38.794283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.794754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.795248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] PATH_INFO: `/v3/projects/248c74387a684b19849ab8c71a30c558/users/1cfe5d37afb94faca7f734462bd6704a/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.818846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=248c74387a684b19849ab8c71a30c558, user_id=1cfe5d37afb94faca7f734462bd6704a, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:38.821587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:38.840387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 956/1896] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:38 2022] PUT /identity/v3/projects/248c74387a684b19849ab8c71a30c558/users/1cfe5d37afb94faca7f734462bd6704a/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:38.851660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:38.852197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:38.852587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:38.883067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] MFA Rules not processed for user `1cfe5d37afb94faca7f734462bd6704a`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:38.884561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:38.966933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 941/1897] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:38.971413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.040957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd01ce-fb54-441b-a3cf-190d4448b9f0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.046056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.046754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.047060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.047346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.048276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.050864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.094006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 957/1898] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:38 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:39.098760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.113462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5d6880-dee3-4dec-ad2b-e07107ea3d43 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.121227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.123369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:39.201748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:39.217359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.218203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.218674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.219019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.219882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.222737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.230890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de92d1b-c00e-4cfa-b6e9-46a46c858337 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.238411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.239870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.240168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.240494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] PATH_INFO: `/v3/projects/cdcf0bba037949749c603512de6bdb58` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.241952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcf0bba037949749c603512de6bdb58)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.244008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.261801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 942/1899] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:39 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:39.262771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.278167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd990-f6d7-4828-a26d-735f99db4af3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.285125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.285893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.286230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.286509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.287248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.288926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.302042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 943/1900] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:39.305931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcf0bba037949749c603512de6bdb58', 'request_id': 'req-6a250975-f671-4696-a77b-7c085abd9f1d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:39.306119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.314482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcf0bba037949749c603512de6bdb58', 'request_id': 'req-6a250975-f671-4696-a77b-7c085abd9f1d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:39.317356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b551-dee4-4a7b-b9c3-0241dd863b92 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.317923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:39.325286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcf0bba037949749c603512de6bdb58', 'request_id': 'req-6a250975-f671-4696-a77b-7c085abd9f1d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:39.340895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] The token cache is being invalidate because project cdcf0bba037949749c603512de6bdb58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:39.341283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:39.342058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-6a250975-f671-4696-a77b-7c085abd9f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:39.343679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 958/1901] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:39 2022] DELETE /identity/v3/projects/cdcf0bba037949749c603512de6bdb58 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:39.348812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34782ef8-c528-42e5-83e3-b3d0d7bb69bb None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.349134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34782ef8-c528-42e5-83e3-b3d0d7bb69bb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.349381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34782ef8-c528-42e5-83e3-b3d0d7bb69bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.369761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-34782ef8-c528-42e5-83e3-b3d0d7bb69bb None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:39.370981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-34782ef8-c528-42e5-83e3-b3d0d7bb69bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:39.393426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.394666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.395095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.396242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] PATH_INFO: `/v3/projects/b609f4266d6a41fca09997e69c708f62/users/c1b18ee66416446997b880e9666987e0/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.416241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b609f4266d6a41fca09997e69c708f62, user_id=c1b18ee66416446997b880e9666987e0, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.418892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.433469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 944/1902] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:39 2022] PUT /identity/v3/projects/b609f4266d6a41fca09997e69c708f62/users/c1b18ee66416446997b880e9666987e0/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:39.437613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.439741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:39.443531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 959/1903] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:39.450980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.451274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.451598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.473203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:39.474850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:39.531365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b3d6-3389-46aa-a285-584b0d9ea589 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.538058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.538916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.539279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.539622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.540663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.542494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.555743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 960/1904] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:39.556343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 945/1905] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:39.560076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.560229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.571414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68829db-0735-4cfd-96ea-9b811a103de0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.571833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5973cf3-ef25-4d25-bd27-04472dcd759f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.576237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.577036 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.577310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.577519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.577886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298ed61-708d-4f64-a3d3-17abb0605f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.578279 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:39.578586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.578849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ed61-708d-4f64-a3d3-17abb0605f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.579142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ed61-708d-4f64-a3d3-17abb0605f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.579459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298ed61-708d-4f64-a3d3-17abb0605f5f admin admin] PATH_INFO: `/v3/projects/b609f4266d6a41fca09997e69c708f62/users/c1b18ee66416446997b880e9666987e0/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.580272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.582103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ed61-708d-4f64-a3d3-17abb0605f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b609f4266d6a41fca09997e69c708f62, user_id=c1b18ee66416446997b880e9666987e0, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.586172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298ed61-708d-4f64-a3d3-17abb0605f5f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.595352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 961/1906] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:47:39.599546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.605639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 946/1907] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:39 2022] PUT /identity/v3/projects/b609f4266d6a41fca09997e69c708f62/users/c1b18ee66416446997b880e9666987e0/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:39.610294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689c7da-548b-4464-94a0-c83c9dd501eb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.617255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.617565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.617901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.646463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] MFA Rules not processed for user `c1b18ee66416446997b880e9666987e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:39.647734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:39.678399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:39.691495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.692514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.693051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.693620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.694981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.698604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.740922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:39.741503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 962/1908] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:39 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:39.749163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.757806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 947/1909] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:39.770523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.772097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:39.835795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eec622-eb07-4ec6-90bd-febafe53c2b9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.840983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.841514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.841806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.842090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.842931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.844785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.858985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca10e0-7d29-4974-9aa4-6221a5280a7d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.869103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 963/1910] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:39 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:39.873401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.883431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ea95-05ef-45a1-af9c-54ee0db1f792 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.888297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.889055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.889246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.889528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.890257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.891901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.909661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 964/1911] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:39.913624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.926677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc304d-571d-4a32-bd08-d70641c9df19 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.927408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.928252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.928821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.929245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.931895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.932713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.933016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.933300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.934031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:39.935729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:39.949758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 965/1912] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:39.954063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:39.967415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3242f-decb-49c8-9b9f-21f62074aa85 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:39.974104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d195aaf-e027-41b1-bcc3-f61d02c5cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:39.979758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195aaf-e027-41b1-bcc3-f61d02c5cfd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:39.979758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195aaf-e027-41b1-bcc3-f61d02c5cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:39.979758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d195aaf-e027-41b1-bcc3-f61d02c5cfd2 admin admin] PATH_INFO: `/v3/projects/5d619199d5154490bc35b2619eee5a73/users/28cbe881db384fa7bd50ce22a7eb878e/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:39.999775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d195aaf-e027-41b1-bcc3-f61d02c5cfd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d619199d5154490bc35b2619eee5a73, user_id=28cbe881db384fa7bd50ce22a7eb878e, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.003901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d195aaf-e027-41b1-bcc3-f61d02c5cfd2 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.022102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.024166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.034249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 966/1913] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:39 2022] PUT /identity/v3/projects/5d619199d5154490bc35b2619eee5a73/users/28cbe881db384fa7bd50ce22a7eb878e/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:40.045950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 948/1914] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:40.052396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.052743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.053030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.087309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] MFA Rules not processed for user `28cbe881db384fa7bd50ce22a7eb878e`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:40.088720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:40.177209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 967/1915] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:40.181369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.197187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e3edf-bdcb-4842-ae4e-472a4441af97 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.234097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.235680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:40.246690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:40.281176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:40.290249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.292587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.294432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.294742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.295500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.298766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.314232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beff9a4-658f-4f45-afd6-c81a1c39841d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.320741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.321520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.321876 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.322235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.325096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:40.341139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 949/1916] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:40 2022] POST /identity/v3/projects => generated 381 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:40.346253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.415115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.417169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.444759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dff0cc-02f9-496b-a059-56d69d5a3efa admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.449926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.450624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.450907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.451219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.451923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.452703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 968/1917] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:40.454180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.481158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 950/1918] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:40 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:40.487419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.510451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066aed8-68e0-4cc1-8325-590f71063fa4 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.518528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.519765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.520134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.520488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.521290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.524455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.543525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 969/1919] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:40.548737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.566714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f5fe-3a0c-4da3-9db8-3b059b193ef2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.570719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.571674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.571960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.572234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] PATH_INFO: `/v3/projects/f475fa363dcc40248e371cc3b1bc3978/users/8f2f66e57be241748c40f00e1be3ecf6/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.588932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f475fa363dcc40248e371cc3b1bc3978, user_id=8f2f66e57be241748c40f00e1be3ecf6, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.592055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.607220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 951/1920] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:40 2022] PUT /identity/v3/projects/f475fa363dcc40248e371cc3b1bc3978/users/8f2f66e57be241748c40f00e1be3ecf6/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:40.611163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.621831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691f5a1-48d6-49e1-86e1-3ec6d9d393bb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.661520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.663553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:40.699876 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.700670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.700961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.701970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.702078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.703713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.718055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 970/1921] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:40.719246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.731280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18eafd-16fb-4f1d-98a0-fcd298c6cbbe admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.732611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa14bea-50bd-455e-b1b8-86f5c9b703a9 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:40.738271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba78bc3-4507-4eb5-8445-4deb68867042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.739883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78bc3-4507-4eb5-8445-4deb68867042 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.740380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78bc3-4507-4eb5-8445-4deb68867042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.740873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba78bc3-4507-4eb5-8445-4deb68867042 admin admin] PATH_INFO: `/v3/projects/f475fa363dcc40248e371cc3b1bc3978/users/8f2f66e57be241748c40f00e1be3ecf6/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.741646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:40.743351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba78bc3-4507-4eb5-8445-4deb68867042 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f475fa363dcc40248e371cc3b1bc3978, user_id=8f2f66e57be241748c40f00e1be3ecf6, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.743791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.744251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.744531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] PATH_INFO: `/v3/users/e600ce105a1a4c9bb5c914cb2a8e8f0d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.746810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e600ce105a1a4c9bb5c914cb2a8e8f0d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:40.748125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba78bc3-4507-4eb5-8445-4deb68867042 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.749328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:40.765569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 971/1922] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:40 2022] PUT /identity/v3/projects/f475fa363dcc40248e371cc3b1bc3978/users/8f2f66e57be241748c40f00e1be3ecf6/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:40.778009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0efdfe-f7a4-4a31-ba14-d46939c52f87 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.778317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0efdfe-f7a4-4a31-ba14-d46939c52f87 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.778860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0efdfe-f7a4-4a31-ba14-d46939c52f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.802821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:40.827857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-af0efdfe-f7a4-4a31-ba14-d46939c52f87 None None] MFA Rules not processed for user `8f2f66e57be241748c40f00e1be3ecf6`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:40.829521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-af0efdfe-f7a4-4a31-ba14-d46939c52f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:40.901352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e600ce105a1a4c9bb5c914cb2a8e8f0d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:40.902064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e600ce105a1a4c9bb5c914cb2a8e8f0d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:40.910840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e600ce105a1a4c9bb5c914cb2a8e8f0d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:40.911868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e600ce105a1a4c9bb5c914cb2a8e8f0d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:40.914396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:40.930609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e600ce105a1a4c9bb5c914cb2a8e8f0d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:40.951756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 952/1923] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:40 2022] DELETE /identity/v3/users/e600ce105a1a4c9bb5c914cb2a8e8f0d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:40.951756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:40.953062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 972/1924] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:40.953381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:40.954478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:40.954781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:40.955063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:40.974976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:40.976197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.030776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2010ee-30f7-4bd3-bfd9-099b35413c43 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:41.038047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:41.039034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.039419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.042883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] PATH_INFO: `/v3/users/1cfe5d37afb94faca7f734462bd6704a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.043031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 973/1925] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:41.043031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:41.043196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cfe5d37afb94faca7f734462bd6704a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:41.043196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:41.044261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.099507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cfe5d37afb94faca7f734462bd6704a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.100569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cfe5d37afb94faca7f734462bd6704a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.108456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cfe5d37afb94faca7f734462bd6704a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.109212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cfe5d37afb94faca7f734462bd6704a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.116743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af152ba-3cce-4f68-a023-93825941b68c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:41.120419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:41.121018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.121307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.121587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.123422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.135947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cfe5d37afb94faca7f734462bd6704a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.153296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 953/1926] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:40 2022] DELETE /identity/v3/users/1cfe5d37afb94faca7f734462bd6704a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:41.154658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:41.156658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.175794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:41.203329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:41.206192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5593e5-be54-4901-ab82-7afa3ce2cd85 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:41.224028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 974/1927] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:41.225796 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.226150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.226521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.228752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99748c91-c3d4-4533-86d8-a1beca625ba0 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:41.237730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:41.238397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.238784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.239067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.240943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.251165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:41.252814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.303338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:41.363515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:41.365106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:41.369372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 975/1928] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:41.385157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:41.387271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 954/1929] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:41.417621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c9e51-7fce-49ce-bb32-2450898003b3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:41.425774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:41.426148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:41.427605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.428921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.429412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.429700 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.454693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:41.458417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:41.487972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 976/1930] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:41.585297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:41.586874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.593739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0b000-cd09-42ec-bf77-0441eac70a6c service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:41.603388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b291495-08c0-490b-8456-fadf06ff8978 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:41.603573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:41.604310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.604765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.605106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.607840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.609069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:41.610189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.610520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.610867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] PATH_INFO: `/v3/users/1a8650e9c303495b8b279fded5caa61d` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.612950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8650e9c303495b8b279fded5caa61d)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:41.615162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:41.681266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8650e9c303495b8b279fded5caa61d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.709591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8650e9c303495b8b279fded5caa61d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.724951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:41.727401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471982-4233-4cf0-a370-290baeaa7f9f service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:41.735678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8650e9c303495b8b279fded5caa61d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.737087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8650e9c303495b8b279fded5caa61d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.737879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8650e9c303495b8b279fded5caa61d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:41.759733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 955/1931] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:41.769756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 977/1932] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:41 2022] DELETE /identity/v3/users/1a8650e9c303495b8b279fded5caa61d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:41.774195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:41.774517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:41.774795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:41.808848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:41.815661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:41.836652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:41.900682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 956/1933] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:41.921074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:41.922959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:42.009315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:42.010763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:42.032310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabee8d8-afe5-4ec5-80a1-e636c886b7ee admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:42.033245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca469af-ce49-4a6b-93e7-842ec199a6c8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:42.040644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:42.041894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.042220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.042442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.044974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:42.045841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.046121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.046392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] PATH_INFO: `/v3/projects/0c24d840f593412da4c63d7c2fdc13ff` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.047605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c24d840f593412da4c63d7c2fdc13ff)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:42.050183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:42.070707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:42.072465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:42.090628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 978/1934] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:42.091540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:42.093224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:42.108076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586884d8-dc86-4097-b6fa-03f15c6368df service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:42.120779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c24d840f593412da4c63d7c2fdc13ff', 'request_id': 'req-5b76c683-33b6-4449-a98a-411e01aaa7b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.128368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c24d840f593412da4c63d7c2fdc13ff', 'request_id': 'req-5b76c683-33b6-4449-a98a-411e01aaa7b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.136139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c24d840f593412da4c63d7c2fdc13ff', 'request_id': 'req-5b76c683-33b6-4449-a98a-411e01aaa7b8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.156140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:42.177311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] The token cache is being invalidate because project 0c24d840f593412da4c63d7c2fdc13ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:42.177640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.178414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.183188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 957/1935] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:42 2022] DELETE /identity/v3/projects/0c24d840f593412da4c63d7c2fdc13ff => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:42.186737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:42.189539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:42.202837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:42.204079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.204844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.205985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] PATH_INFO: `/v3/projects/248c74387a684b19849ab8c71a30c558` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.207534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] RBAC: Authorizing `identity:delete_project(project_id=248c74387a684b19849ab8c71a30c558)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:42.210740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:42.276360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '248c74387a684b19849ab8c71a30c558', 'request_id': 'req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.282710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '248c74387a684b19849ab8c71a30c558', 'request_id': 'req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.301588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '248c74387a684b19849ab8c71a30c558', 'request_id': 'req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.324537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] The token cache is being invalidate because project 248c74387a684b19849ab8c71a30c558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:42.324886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.327003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.328830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 979/1936] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:42 2022] DELETE /identity/v3/projects/248c74387a684b19849ab8c71a30c558 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:42.333025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:42.335751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:42.337342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76c683-33b6-4449-a98a-411e01aaa7b8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:42.423243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:42.436972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:42.437893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.438947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.439160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] PATH_INFO: `/v3/users/c96903ee48994b2e8df029261dd95b6e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.443037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96903ee48994b2e8df029261dd95b6e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:42.444840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:42.471170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8d2de-3b96-42e9-84e9-b7ce066d100d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:42.478915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:42.480342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.480981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.481266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] PATH_INFO: `/v3/users/c1b18ee66416446997b880e9666987e0` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.482696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b18ee66416446997b880e9666987e0)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:42.485034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:42.512810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96903ee48994b2e8df029261dd95b6e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.514065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96903ee48994b2e8df029261dd95b6e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.522809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96903ee48994b2e8df029261dd95b6e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.523617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96903ee48994b2e8df029261dd95b6e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.543806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96903ee48994b2e8df029261dd95b6e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.563174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 958/1937] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:42 2022] DELETE /identity/v3/users/c96903ee48994b2e8df029261dd95b6e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:47:42.564140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:42.571622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:42.582346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b18ee66416446997b880e9666987e0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.608840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b18ee66416446997b880e9666987e0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.612136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:42.623757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b18ee66416446997b880e9666987e0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.625288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b18ee66416446997b880e9666987e0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.626340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c1b135-e0a5-43e4-9f75-7a15c38ebdd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b18ee66416446997b880e9666987e0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.661347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 980/1938] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:42 2022] DELETE /identity/v3/users/c1b18ee66416446997b880e9666987e0 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:42.675966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fef1db-8e53-4e6d-8471-9d139b057bb3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:42.801555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:42.808117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.808117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.808117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] PATH_INFO: `/v3/projects/0691d2822d29455da8338c223504ffc9` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.808117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0691d2822d29455da8338c223504ffc9)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:42.809114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:42.836164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:42.869835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0691d2822d29455da8338c223504ffc9', 'request_id': 'req-fcf4b961-3359-454a-9167-db2d1d1bb078'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.881432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0691d2822d29455da8338c223504ffc9', 'request_id': 'req-fcf4b961-3359-454a-9167-db2d1d1bb078'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.889398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0691d2822d29455da8338c223504ffc9', 'request_id': 'req-fcf4b961-3359-454a-9167-db2d1d1bb078'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.909720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] The token cache is being invalidate because project 0691d2822d29455da8338c223504ffc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:42.910070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.910946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fcf4b961-3359-454a-9167-db2d1d1bb078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:42.913213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 959/1939] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:42 2022] DELETE /identity/v3/projects/0691d2822d29455da8338c223504ffc9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:42.918328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:42.918856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:42.918856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:42.958334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:42.960057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.056293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 981/1940] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:43.066691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.067040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.067354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.092763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.094999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.113240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:43.113240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.138249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a48f1c7-6e4e-4010-8c5d-5926b64b98c8 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.140745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 960/1941] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:43.143820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.146513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.148009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.148569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.149180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] PATH_INFO: `/v3/projects/ced57e31b58b485e844a28a629d39d5e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.150710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced57e31b58b485e844a28a629d39d5e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.152846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.156765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798199d-c454-4e08-8996-ebcf8002d1a4 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.167152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.168358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.168839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.169296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.170243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:43.171312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.173527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.189475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 961/1942] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:43.194361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.196354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.217845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319b5f8-3235-41ef-984c-d7f3de5f4246 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.234084 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced57e31b58b485e844a28a629d39d5e', 'request_id': 'req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.242715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced57e31b58b485e844a28a629d39d5e', 'request_id': 'req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.258879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced57e31b58b485e844a28a629d39d5e', 'request_id': 'req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.272070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] The token cache is being invalidate because project ced57e31b58b485e844a28a629d39d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:43.272376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.273045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.275188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 982/1943] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:43 2022] DELETE /identity/v3/projects/ced57e31b58b485e844a28a629d39d5e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:43.276073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.277421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.310977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.312010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.312365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.312715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] PATH_INFO: `/v3/projects/b609f4266d6a41fca09997e69c708f62` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.314041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b609f4266d6a41fca09997e69c708f62)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.316626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.350344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17157ca0-eb59-457d-8fcd-1b4cd5d18ea8 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.359066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7bc79-e8e2-4b9d-92d8-52bee3a64e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.360118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7bc79-e8e2-4b9d-92d8-52bee3a64e99 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.360412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7bc79-e8e2-4b9d-92d8-52bee3a64e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.360851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7bc79-e8e2-4b9d-92d8-52bee3a64e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.361946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7bc79-e8e2-4b9d-92d8-52bee3a64e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.364347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7bc79-e8e2-4b9d-92d8-52bee3a64e99 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.367572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b609f4266d6a41fca09997e69c708f62', 'request_id': 'req-08b01ec7-448f-4bed-83c5-db88233680f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.373869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b609f4266d6a41fca09997e69c708f62', 'request_id': 'req-08b01ec7-448f-4bed-83c5-db88233680f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.383001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b609f4266d6a41fca09997e69c708f62', 'request_id': 'req-08b01ec7-448f-4bed-83c5-db88233680f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.383171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:43.401695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] The token cache is being invalidate because project b609f4266d6a41fca09997e69c708f62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:43.401970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.402672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-08b01ec7-448f-4bed-83c5-db88233680f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:43.404540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 962/1944] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:43 2022] DELETE /identity/v3/projects/b609f4266d6a41fca09997e69c708f62 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:43.405690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360328e9-b14d-4457-8128-4a67699f6a3c None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.405974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360328e9-b14d-4457-8128-4a67699f6a3c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.406250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360328e9-b14d-4457-8128-4a67699f6a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.411351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 983/1945] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:43.412510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.412808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.413092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.432960 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:43.433311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-360328e9-b14d-4457-8128-4a67699f6a3c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:43.434253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.434550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-360328e9-b14d-4457-8128-4a67699f6a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.450827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:43.511071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 984/1946] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:43.512259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.513708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.520203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 963/1947] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:43.523890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.524916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.525375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.527681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb000a-0e45-40c5-9226-da9222b2a835 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.532545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7412f-e5b2-4350-b2e7-4343b0283e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.533480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7412f-e5b2-4350-b2e7-4343b0283e12 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.533770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7412f-e5b2-4350-b2e7-4343b0283e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.534052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7412f-e5b2-4350-b2e7-4343b0283e12 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.534776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7412f-e5b2-4350-b2e7-4343b0283e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.536881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7412f-e5b2-4350-b2e7-4343b0283e12 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.553145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:43.554715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.565349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 985/1948] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:43.565349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.565349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.565349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.569581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 964/1949] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:43.570639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.583698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a868222-43b2-475c-9d23-92107d2e3617 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.588010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:43.588867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.589232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:43.589983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.590340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.590720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.591601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.593506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.598471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 986/1950] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:43.600467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.605790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 965/1951] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:43.606660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.612639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9214e9-4fe9-4832-abff-2d6b89a65f5b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.618001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65235878-bc55-4e6c-a579-967f57e7c146 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.621616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.622286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.622568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.623003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.623767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.623888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:43.624103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.624924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.625432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.625867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.626213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.627021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:43.627865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.630175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.639350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 987/1952] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:43.639860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.647431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 966/1953] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:43.647431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.655009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817fae27-f5c3-40a9-9977-4e144374df02 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.659313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ea490-01bc-438d-a7d5-c4f418fdcebb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.663932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.663932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.663932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.663932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.664218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.664617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.667948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.668763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.669231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.669683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.670636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.674701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.681198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 988/1954] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:43.681198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.693250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e149d-fcbe-4a18-b629-abc1fd2ac3eb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.698608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.699263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.699580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.699857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.700546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.702599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.704482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 967/1955] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:43.705531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.735408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 989/1956] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/projects => generated 381 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:43.735408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.773957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce15d8a-3f2b-4da8-b158-e5bfee091bb7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.805367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59519219-cf51-4179-bad4-0f286973ccfb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.810725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.811721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.811721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.812178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.812853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.815381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.839643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 990/1957] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:43.840923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.851938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.852275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55128827-4152-454c-bf37-fcc8dcca27ee admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.852879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.853189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.853531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] PATH_INFO: `/v3/projects/231c5160113b477a931c2e1347e50cda/users/05a874ebf0124b958716d9ea1a121960/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.858566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.859368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.860051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.860051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.860859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.863565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.874254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:INSERT=11,keystone:SELECT=89 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:43.875607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] RBAC: Authorizing `identity:create_grant(project_id=231c5160113b477a931c2e1347e50cda, user_id=05a874ebf0124b958716d9ea1a121960, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.882825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.884878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:43.891290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 991/1958] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/users => generated 291 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:43.892490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.897931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 968/1959] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:43 2022] PUT /identity/v3/projects/231c5160113b477a931c2e1347e50cda/users/05a874ebf0124b958716d9ea1a121960/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:43.899674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:43.911628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7307d5dd-1862-4fc7-8677-6ad237a31946 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:43.981732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e080ce2-82e6-4470-a561-3d0648d31745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:43.983417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e080ce2-82e6-4470-a561-3d0648d31745 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.983417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e080ce2-82e6-4470-a561-3d0648d31745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.983417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e080ce2-82e6-4470-a561-3d0648d31745 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:43.983805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e080ce2-82e6-4470-a561-3d0648d31745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:43.985311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e080ce2-82e6-4470-a561-3d0648d31745 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:43.999374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 992/1960] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:43.999374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:43.999374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:43.999374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.005651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e9ae2-37bc-4cbd-97bf-343a9f20811b admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.011630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.012733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.012854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.013470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.013779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.016089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.027382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 969/1961] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:44.028315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.031371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] MFA Rules not processed for user `05a874ebf0124b958716d9ea1a121960`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:44.033138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.039800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f12a4-d716-4ad9-8002-4d9652d8a27e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.045019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.045683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.045975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.046254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.047105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.049498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.060037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 970/1962] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:44.060977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.062916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.076550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b092a-bc95-4ee3-b513-2bc7a4ee666e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.081798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.082771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.083118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.083488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] PATH_INFO: `/v3/users/358dafb2e91c4f188ac471ce3cb75dba` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.085506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] RBAC: Authorizing `identity:delete_user(user_id=358dafb2e91c4f188ac471ce3cb75dba)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.086749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.107754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 993/1963] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:44.112870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.127134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093acc22-29f8-43eb-9ed1-9fbeccc2ff03 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.133368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.134046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.134309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.134784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.135671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.137527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.148494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 994/1964] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:44.149490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.155769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358dafb2e91c4f188ac471ce3cb75dba'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:44.157470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358dafb2e91c4f188ac471ce3cb75dba'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:44.161173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8885-82b5-4e29-89cc-6522d63719a0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.166306 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.167205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.167340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358dafb2e91c4f188ac471ce3cb75dba'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:44.167603 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.167967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] PATH_INFO: `/v3/projects/b9afe0608615425c9b63acc9b96a9675/users/20d1019fff884ec9bc616b03388cfcf5/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.168076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358dafb2e91c4f188ac471ce3cb75dba'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:44.185331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358dafb2e91c4f188ac471ce3cb75dba'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:44.191813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9afe0608615425c9b63acc9b96a9675, user_id=20d1019fff884ec9bc616b03388cfcf5, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.194762 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.209220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 971/1965] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:44 2022] DELETE /identity/v3/users/358dafb2e91c4f188ac471ce3cb75dba => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:44.210465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.210589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 995/1966] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:44 2022] PUT /identity/v3/projects/b9afe0608615425c9b63acc9b96a9675/users/20d1019fff884ec9bc616b03388cfcf5/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:44.215628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.216793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.217874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.276032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:44.295135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03586cc-755c-4fa9-85a0-59f6088dfdae admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.300705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029fa47-0906-4c1b-af5b-4147b21b010a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.306152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.308602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.308602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.308602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.310561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.318467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:44.374911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e29ca0-d221-4ab5-b065-6eab2f971d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.376250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e29ca0-d221-4ab5-b065-6eab2f971d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.376538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e29ca0-d221-4ab5-b065-6eab2f971d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.376819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e29ca0-d221-4ab5-b065-6eab2f971d02 admin admin] PATH_INFO: `/v3/projects/a5b2ff80c04e44f89234cb880670f2fc/users/314cd5bcba0741deb191dcd45e475f83/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.393377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e29ca0-d221-4ab5-b065-6eab2f971d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b2ff80c04e44f89234cb880670f2fc, user_id=314cd5bcba0741deb191dcd45e475f83, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.396132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e29ca0-d221-4ab5-b065-6eab2f971d02 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.396833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.398435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59beecb4-63e9-4537-83d8-4e616b62e581 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.411075 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 972/1967] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:44.412457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f310ab6-95b6-461a-8e98-4d0d191fab5f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.412757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f310ab6-95b6-461a-8e98-4d0d191fab5f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.413733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f310ab6-95b6-461a-8e98-4d0d191fab5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.432487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 996/1968] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:44 2022] PUT /identity/v3/projects/a5b2ff80c04e44f89234cb880670f2fc/users/314cd5bcba0741deb191dcd45e475f83/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:44.435080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.436149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.436149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.440004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2f310ab6-95b6-461a-8e98-4d0d191fab5f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:44.441229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2f310ab6-95b6-461a-8e98-4d0d191fab5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.474804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] MFA Rules not processed for user `20d1019fff884ec9bc616b03388cfcf5`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:44.476221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.535709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 973/1969] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:44.541052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.541747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.542191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.562049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 997/1970] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:44.565567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.565567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.581983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] MFA Rules not processed for user `314cd5bcba0741deb191dcd45e475f83`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:44.583525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.681228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 974/1971] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:44.682583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.684483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.684972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d65fd0-7ab5-4864-8413-ddc033e19dc0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.689127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.690616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.691080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.691402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.703277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.704859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295625e-ee4a-47d2-a9b8-aa6a019f4d50 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.707109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.712343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.713068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.713361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.713687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.714597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.717228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.735556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 998/1972] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:44.744709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.756497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7df0e-51f8-4419-a05b-57500d0be568 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.771405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 975/1973] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:44.771405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.773598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.774425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.774775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.775255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.776307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.777982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:44.778701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.784166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:44.823982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:44.842861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 999/1974] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:44.842861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:44.938296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c9360-7a66-45e8-b583-15d06b4e1a36 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.958734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50654ebf-a3fe-471c-871f-90a313f10681 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:44.964362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:44.965880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:44.966756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:44.966756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:44.968079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:44.969929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:44.998289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1000/1975] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:44.999432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.011182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b6a9-4ad8-4d0d-838f-9b6fbdeab4dc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.017006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794804-b259-4349-9b00-c091f2080ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.017925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794804-b259-4349-9b00-c091f2080ecb admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.018405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794804-b259-4349-9b00-c091f2080ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.019266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794804-b259-4349-9b00-c091f2080ecb admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.020265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794804-b259-4349-9b00-c091f2080ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.022683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794804-b259-4349-9b00-c091f2080ecb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.035222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.036261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.036601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.037048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] PATH_INFO: `/v3/users/28cbe881db384fa7bd50ce22a7eb878e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.038397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28cbe881db384fa7bd50ce22a7eb878e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.040464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.047206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1001/1976] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:44 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:45.047206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649b77-0182-492f-90e2-e899b367b58d None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.047206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649b77-0182-492f-90e2-e899b367b58d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.047206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a649b77-0182-492f-90e2-e899b367b58d None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.047689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1002/1977] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:47:45.048393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649b77-0182-492f-90e2-e899b367b58d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.062508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a649b77-0182-492f-90e2-e899b367b58d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.068345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.069006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.069296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.069957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.070299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.071980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.083698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1003/1978] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:45.084533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.097436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce971-4da0-4bb4-b871-9a15146d1882 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.102882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28cbe881db384fa7bd50ce22a7eb878e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.103601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28cbe881db384fa7bd50ce22a7eb878e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.106787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c4ba8-56a1-4238-a601-bdcddfe83a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.107593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4ba8-56a1-4238-a601-bdcddfe83a79 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.108206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4ba8-56a1-4238-a601-bdcddfe83a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.109181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c4ba8-56a1-4238-a601-bdcddfe83a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.110135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4ba8-56a1-4238-a601-bdcddfe83a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.110550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28cbe881db384fa7bd50ce22a7eb878e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.111223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28cbe881db384fa7bd50ce22a7eb878e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.113954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c4ba8-56a1-4238-a601-bdcddfe83a79 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.124158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28cbe881db384fa7bd50ce22a7eb878e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.125582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1004/1979] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:45.127003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a11b56-8df5-44a3-9712-ab3cbb23b7df None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.128034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a11b56-8df5-44a3-9712-ab3cbb23b7df None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.128254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a11b56-8df5-44a3-9712-ab3cbb23b7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.140319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 976/1980] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:44 2022] DELETE /identity/v3/users/28cbe881db384fa7bd50ce22a7eb878e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:45.144309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.145831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.148296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-20a11b56-8df5-44a3-9712-ab3cbb23b7df None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:45.149904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-20a11b56-8df5-44a3-9712-ab3cbb23b7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.198559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:45.221509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bde31-b3e9-4c03-aec7-331ae60c4c49 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.227889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.230313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.230830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.231396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.232166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.233799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.248211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 977/1981] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:45.249105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.250891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.254244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1005/1982] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:45.256685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.256685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.257023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.264835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74df27-6aa2-4c2d-8d3a-2a527d509c70 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.270844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.272189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.273701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.274166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] PATH_INFO: `/v3/projects/13c321ceca7141a593e3a056d72817e7/users/a89e89f2ab394472b90ab78c4690cce4/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.284169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:45.285653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.292005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c321ceca7141a593e3a056d72817e7, user_id=a89e89f2ab394472b90ab78c4690cce4, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.295503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.296959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1006/1983] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:45.297818 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.300010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.316388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701c167-cbe6-466d-a032-9fd155b48a5b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.317208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 978/1984] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:45 2022] PUT /identity/v3/projects/13c321ceca7141a593e3a056d72817e7/users/a89e89f2ab394472b90ab78c4690cce4/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:45.318602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.336701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:45.382256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.383148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.383467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.383750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] PATH_INFO: `/v3/projects/b255cba3794e4f46b306dec6e00e3c50` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.385097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b255cba3794e4f46b306dec6e00e3c50)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.387123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.406149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cb56b-114d-4e2d-94c1-75cc922b7393 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.412065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.413023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.413574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.413967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] PATH_INFO: `/v3/projects/74385b703f594b1ca43299967e0a0029/users/666b50a6d8da49b3ac03f161885505ca/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.439796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=74385b703f594b1ca43299967e0a0029, user_id=666b50a6d8da49b3ac03f161885505ca, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.442602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.454634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b255cba3794e4f46b306dec6e00e3c50', 'request_id': 'req-ab2fb850-2801-4263-9f96-156d445e88d7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.457334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 979/1985] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:45 2022] PUT /identity/v3/projects/74385b703f594b1ca43299967e0a0029/users/666b50a6d8da49b3ac03f161885505ca/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:45.458384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.460214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.461205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b255cba3794e4f46b306dec6e00e3c50', 'request_id': 'req-ab2fb850-2801-4263-9f96-156d445e88d7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.473239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b255cba3794e4f46b306dec6e00e3c50', 'request_id': 'req-ab2fb850-2801-4263-9f96-156d445e88d7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.485634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] The token cache is being invalidate because project b255cba3794e4f46b306dec6e00e3c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:45.486061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.488307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.491738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1007/1986] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:45 2022] DELETE /identity/v3/projects/b255cba3794e4f46b306dec6e00e3c50 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:45.491738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.491738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.548844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c448a28-26e1-48e8-ac23-5f10df1597fb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.555283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.555966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.556254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.556587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.558731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.563013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2fb850-2801-4263-9f96-156d445e88d7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.573496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.575093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.590200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 980/1987] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:45.591222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.593236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.621233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.622114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.622391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.622741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.624960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:45.625244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.656247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:45.676720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1733-b4e6-4df7-8b90-01036d8b5368 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.683886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8147ec-dc8b-4e4e-8f7a-cc36c5f94902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.684788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8147ec-dc8b-4e4e-8f7a-cc36c5f94902 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.685294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8147ec-dc8b-4e4e-8f7a-cc36c5f94902 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.685578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8147ec-dc8b-4e4e-8f7a-cc36c5f94902 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.686323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8147ec-dc8b-4e4e-8f7a-cc36c5f94902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.688568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8147ec-dc8b-4e4e-8f7a-cc36c5f94902 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.701964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 981/1988] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:45.707048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.707273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.707584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.710395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.712857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.724335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1008/1989] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:45.725385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.726985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.740409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] MFA Rules not processed for user `666b50a6d8da49b3ac03f161885505ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:45.740860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c22a6a-436d-4eaf-89ad-0a8fedc1960c service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.742190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.745900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.746986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.747394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.747754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] PATH_INFO: `/v3/users/20f99e1c23a443ef8c6c03fff2fba767` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.749185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f99e1c23a443ef8c6c03fff2fba767)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.751403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:45.820231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f99e1c23a443ef8c6c03fff2fba767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.837324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f99e1c23a443ef8c6c03fff2fba767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.851408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f99e1c23a443ef8c6c03fff2fba767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.851408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f99e1c23a443ef8c6c03fff2fba767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.851408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f99e1c23a443ef8c6c03fff2fba767'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:45.866451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 982/1990] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:45.866451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.867502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1009/1991] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:45 2022] DELETE /identity/v3/users/20f99e1c23a443ef8c6c03fff2fba767 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:45.868536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:45.870046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:45.884258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e533fe6-f002-45c4-b547-93c99f054c02 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.971612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9c5d3-d207-4a5e-864e-925f198ab4f8 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:45.977262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:45.977965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:45.978252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:45.978648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:45.979399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:45.982052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.003710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578394aa-0fe9-4016-814a-eaa21d66d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.004592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578394aa-0fe9-4016-814a-eaa21d66d9ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.004882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578394aa-0fe9-4016-814a-eaa21d66d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.005196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578394aa-0fe9-4016-814a-eaa21d66d9ff admin admin] PATH_INFO: `/v3/projects/13c321ceca7141a593e3a056d72817e7/users/a89e89f2ab394472b90ab78c4690cce4/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.008866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578394aa-0fe9-4016-814a-eaa21d66d9ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c321ceca7141a593e3a056d72817e7, user_id=a89e89f2ab394472b90ab78c4690cce4, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.010629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578394aa-0fe9-4016-814a-eaa21d66d9ff admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.019189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1010/1992] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:45 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:46.023516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.038509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 983/1993] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:45 2022] PUT /identity/v3/projects/13c321ceca7141a593e3a056d72817e7/users/a89e89f2ab394472b90ab78c4690cce4/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:46.040299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.040799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.041266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.075075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:46.075857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] MFA Rules not processed for user `a89e89f2ab394472b90ab78c4690cce4`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:46.077226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:46.119029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:46.137257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e00dbd-9b1d-4aeb-99ed-500c83516c04 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.143693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.144434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.156793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.157201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.157963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.162275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.177979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 984/1994] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:46.187655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1011/1995] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:46 2022] POST /identity/v3/users => generated 295 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:46.191764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.194588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:46.199452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.217593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f461be-cb19-4b03-b82e-d1dbc54f69ac admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.229913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.230788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.231082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.231502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.232393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.234159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.250482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1012/1996] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:46.255682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.275806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dda06e-bf6a-4720-af2a-4b971cf1a48e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.289456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.312090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.312653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.312952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] PATH_INFO: `/v3/projects/843d167a469d4b77a290bf3cbf2cfcbe/users/f0b0defe98744fec842b062d4fbf5ed3/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.344082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4382a32-90ae-4e35-9458-82db73c04192 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.354593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.355451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.355887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.356391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.364796 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=843d167a469d4b77a290bf3cbf2cfcbe, user_id=f0b0defe98744fec842b062d4fbf5ed3, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.374504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.382788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.386459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.420161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1013/1997] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:46 2022] PUT /identity/v3/projects/843d167a469d4b77a290bf3cbf2cfcbe/users/f0b0defe98744fec842b062d4fbf5ed3/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:46.423838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.438440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:46.457148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 985/1998] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:46.460545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.488749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51fc62-757b-4b16-9bed-897604eeef48 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.610227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9becdf-020e-43c0-8488-a802279345fb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.620371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.621807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.622098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.622378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] PATH_INFO: `/v3/projects/5d619199d5154490bc35b2619eee5a73` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.626447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.626702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d619199d5154490bc35b2619eee5a73)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.629240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.629664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.630086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.630901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.634300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.636316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.654658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 986/1999] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:46.658556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.666342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:46.706401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3303ea99-aa09-4acc-8453-9f43026de953 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.718755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.720767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.721505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.722210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] PATH_INFO: `/v3/projects/e3711f2ffdac47098c1c47fff6434517` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.724190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3711f2ffdac47098c1c47fff6434517)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.727192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:46.746158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d619199d5154490bc35b2619eee5a73', 'request_id': 'req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.756075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d619199d5154490bc35b2619eee5a73', 'request_id': 'req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.769296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d619199d5154490bc35b2619eee5a73', 'request_id': 'req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.790125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] The token cache is being invalidate because project 5d619199d5154490bc35b2619eee5a73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:46.790125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.792708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:46.793518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.801834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1014/2000] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:46 2022] DELETE /identity/v3/projects/5d619199d5154490bc35b2619eee5a73 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:46.803134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.820338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:46.838679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3711f2ffdac47098c1c47fff6434517', 'request_id': 'req-01e44fab-540d-448f-8bfc-e5d1622bcfed'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.852042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3711f2ffdac47098c1c47fff6434517', 'request_id': 'req-01e44fab-540d-448f-8bfc-e5d1622bcfed'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.854303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:46.861995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3711f2ffdac47098c1c47fff6434517', 'request_id': 'req-01e44fab-540d-448f-8bfc-e5d1622bcfed'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.883765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] The token cache is being invalidate because project e3711f2ffdac47098c1c47fff6434517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:46.884037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.884708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:46.889629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 987/2001] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:46 2022] DELETE /identity/v3/projects/e3711f2ffdac47098c1c47fff6434517 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:46.889629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:46.895700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:46.938621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3f94a-dbf3-4402-a854-8ebefb3ae241 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.977093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e44fab-540d-448f-8bfc-e5d1622bcfed admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:46.983656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:46.984742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:46.985022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:46.985294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] PATH_INFO: `/v3/projects/843d167a469d4b77a290bf3cbf2cfcbe/users/f0b0defe98744fec842b062d4fbf5ed3/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:46.987373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843d167a469d4b77a290bf3cbf2cfcbe, user_id=f0b0defe98744fec842b062d4fbf5ed3, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:46.990026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.013177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 988/2002] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:46 2022] PUT /identity/v3/projects/843d167a469d4b77a290bf3cbf2cfcbe/users/f0b0defe98744fec842b062d4fbf5ed3/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:47.013177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.017240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.020545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.021747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.022187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.022618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.025483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.097707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56811cd1-826a-45c7-b3fa-0abe72c1c8e6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.103592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.104044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.104980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.105278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.105390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8efe8c-8cce-4af8-abbe-0344ce7b26c1 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.105561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] PATH_INFO: `/v3/users/8f2f66e57be241748c40f00e1be3ecf6` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.106858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2f66e57be241748c40f00e1be3ecf6)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.108807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.116207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1015/2003] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:47.119721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b17e3-b3c2-4da6-a271-409825d63f20 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.120052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b17e3-b3c2-4da6-a271-409825d63f20 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.120415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b17e3-b3c2-4da6-a271-409825d63f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.141482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-551b17e3-b3c2-4da6-a271-409825d63f20 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:47.143278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-551b17e3-b3c2-4da6-a271-409825d63f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.153317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1016/2004] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:47.154672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.154963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.155240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.163803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2f66e57be241748c40f00e1be3ecf6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.164530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2f66e57be241748c40f00e1be3ecf6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.174334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2f66e57be241748c40f00e1be3ecf6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.175262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2f66e57be241748c40f00e1be3ecf6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.192798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-6abd11a0-bfd9-4416-92a7-92e719442304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2f66e57be241748c40f00e1be3ecf6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.197131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] MFA Rules not processed for user `f0b0defe98744fec842b062d4fbf5ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:47.198455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.212588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 989/2005] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:47 2022] DELETE /identity/v3/users/8f2f66e57be241748c40f00e1be3ecf6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:47.216221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.216221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.216221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.222686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:47.238640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:47.240914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.308574 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:47.339360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1017/2006] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:47.349659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 990/2007] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:47.353052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.354204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.354651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.364977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd8806-b9f1-4099-8743-fe7cbfaeb209 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.369435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.370100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.370383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.370753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.371636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:47.371942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.373567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.387148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 991/2008] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:47:47.391523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.402526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637af28-b7c6-4b75-8f1e-344ea961fedf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.408722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.409377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.409662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.409938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.410727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.412834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.431660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e5da5-24c3-4bb2-85b4-8274268ade50 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.443366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 992/2009] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:47.444846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.491111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.492163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.492452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.492731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.495362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.514416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ca7ed-fcbe-4dc7-9ed2-e3a2e26897da admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.519997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.520811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.521097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.521371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.522197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.524151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.552198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 993/2010] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/users => generated 285 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:47.552896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.554476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.568364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f1613-ee98-4705-9301-b68a3ed78045 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.574705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.575601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.575889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.576163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] PATH_INFO: `/v3/projects/f475fa363dcc40248e371cc3b1bc3978` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.577371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] RBAC: Authorizing `identity:delete_project(project_id=f475fa363dcc40248e371cc3b1bc3978)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.579284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.580509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.582083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.591298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1018/2011] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:47.592202 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.602914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09738f-3184-4014-9a40-27a3e7657691 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.608293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.609033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.609344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.609633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.610631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.612996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.623789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1019/2012] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:47.627411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.637955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d34b8c9-1e0f-4f85-8876-d35fa048e9c6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.639701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f475fa363dcc40248e371cc3b1bc3978', 'request_id': 'req-8dd13485-8ad4-47a7-9ecc-9e22b292aada'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.643304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:47.647666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f475fa363dcc40248e371cc3b1bc3978', 'request_id': 'req-8dd13485-8ad4-47a7-9ecc-9e22b292aada'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.656661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f475fa363dcc40248e371cc3b1bc3978', 'request_id': 'req-8dd13485-8ad4-47a7-9ecc-9e22b292aada'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.681015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] The token cache is being invalidate because project f475fa363dcc40248e371cc3b1bc3978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:47.681476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.682127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8dd13485-8ad4-47a7-9ecc-9e22b292aada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:47.684380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 994/2013] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:47 2022] DELETE /identity/v3/projects/f475fa363dcc40248e371cc3b1bc3978 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:47.689322 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c89a2-358c-496f-b0d4-f896646bd2e7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.690804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c89a2-358c-496f-b0d4-f896646bd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.691275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c89a2-358c-496f-b0d4-f896646bd2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.696601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:47.712412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.713086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.714028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.714326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.715340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.717162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.719549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4a7c89a2-358c-496f-b0d4-f896646bd2e7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:47.721304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4a7c89a2-358c-496f-b0d4-f896646bd2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.731290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1020/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:47.732682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 995/2015] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:47.733012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.737149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.740903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.741197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.741526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.754337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847eae-004c-4046-aaf0-b285fac13abd admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.760129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3152b6a-7642-47eb-9a12-be19d6f6d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.761558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3152b6a-7642-47eb-9a12-be19d6f6d68b admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.761558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3152b6a-7642-47eb-9a12-be19d6f6d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.761732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3152b6a-7642-47eb-9a12-be19d6f6d68b admin admin] PATH_INFO: `/v3/projects/b6e0abb79734469ab3c1ee2910e2bfe2/users/83bae636b53b4a209f780d73767f1668/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.780101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3152b6a-7642-47eb-9a12-be19d6f6d68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e0abb79734469ab3c1ee2910e2bfe2, user_id=83bae636b53b4a209f780d73767f1668, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.787563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3152b6a-7642-47eb-9a12-be19d6f6d68b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.787872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:47.787872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.812609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 996/2017] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:47.812800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1021/2017] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:47 2022] PUT /identity/v3/projects/b6e0abb79734469ab3c1ee2910e2bfe2/users/83bae636b53b4a209f780d73767f1668/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:47.815529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:47.817367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.817891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.818411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.831193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1dd96-aa37-42d8-a7ca-bd34d5b9f088 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:47.858234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] MFA Rules not processed for user `83bae636b53b4a209f780d73767f1668`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:47.861785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:47.970279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:47.971664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:47.971951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:47.972229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:47.972971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:47.973278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:47.974893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:47.989533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 997/2018] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:47.994494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.015331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1022/2019] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:48.015697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1159593-297e-469d-b87a-457d23bc89e1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.021855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.024145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.025020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.025451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.025961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.027042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.029638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.046430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1540a19-23f9-41f6-8978-6011060b7d35 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.061019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.061641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.061928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.062210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.065098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.067078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.074627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 998/2020] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:48.080295 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.125773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1023/2021] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:48 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:48.126854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.129424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:48.190215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa8dd-4a34-4373-8bdb-65df9d3312a8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.216978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9992074-eb34-4bc6-9dc2-9a070d82f044 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.223507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.224413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.224699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.225773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] PATH_INFO: `/v3/users/05a874ebf0124b958716d9ea1a121960` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.227369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a874ebf0124b958716d9ea1a121960)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.229340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.252806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:48.274577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.275369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.275656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.275932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.276629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.279812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.286602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:48.309937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 999/2022] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:48 2022] POST /identity/v3/users => generated 287 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:48.310854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.328057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59e4e0-80f8-4cba-afae-b20277a15b7f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.331104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a874ebf0124b958716d9ea1a121960'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:48.335575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.336297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.336583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.336851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.337638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.340657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.364900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a874ebf0124b958716d9ea1a121960'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:48.371653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1000/2023] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:48 2022] POST /identity/v3/users => generated 290 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:48.376150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.381337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a874ebf0124b958716d9ea1a121960'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:48.385462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a874ebf0124b958716d9ea1a121960'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:48.387935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a874ebf0124b958716d9ea1a121960'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:48.391813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5946009-3ea9-4b73-8fa5-3ee0cdab7b71 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.400129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71076bfc-e8b4-4991-b72c-01c23dbe807e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.402579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71076bfc-e8b4-4991-b72c-01c23dbe807e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.403127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71076bfc-e8b4-4991-b72c-01c23dbe807e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.403698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71076bfc-e8b4-4991-b72c-01c23dbe807e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.404743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71076bfc-e8b4-4991-b72c-01c23dbe807e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.407763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71076bfc-e8b4-4991-b72c-01c23dbe807e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.419558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1024/2024] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:48 2022] DELETE /identity/v3/users/05a874ebf0124b958716d9ea1a121960 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:48.419558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.422167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:48.428632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1001/2025] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:48.430087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.430384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.430665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.461033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:48.462755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:48.518324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a6398-fc24-400a-abe5-390e322a3daa admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.524465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.525445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.525984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.526407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.527521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.529655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.545941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1025/2026] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:48.547451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.550343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:48.551071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1002/2027] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:48.555314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.566826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad7e43-9afb-4c75-88bc-cccfcd316cfa None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.572878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.574085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.574230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28449d38-b558-4d81-8dae-a32662818522 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.574342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.574463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] PATH_INFO: `/v3/projects/7edd5b6348804077bd0406c2b8b922dc/users/08cd7b8261f74dfcab197350d58d0c47/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.579782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.581141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.581655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.582035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.582869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.584722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.593347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edd5b6348804077bd0406c2b8b922dc, user_id=08cd7b8261f74dfcab197350d58d0c47, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.599248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1026/2028] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:48.599602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.599691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.601080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:48.612381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1003/2029] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:48 2022] PUT /identity/v3/projects/7edd5b6348804077bd0406c2b8b922dc/users/08cd7b8261f74dfcab197350d58d0c47/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:48.613709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.678040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8bf930-6e0e-44ef-982b-a0865a88937b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.710561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab57bd-c83e-4506-afcb-cac17e6c7db3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.718452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.719655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.720009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.720399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] PATH_INFO: `/v3/projects/621bc0c8a5da40a09755cc47d1bcf924/users/7a22fa0bdd584d0c883bec6d9d7dc773/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.748345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=621bc0c8a5da40a09755cc47d1bcf924, user_id=7a22fa0bdd584d0c883bec6d9d7dc773, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.752884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.779782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1004/2030] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:48 2022] PUT /identity/v3/projects/621bc0c8a5da40a09755cc47d1bcf924/users/7a22fa0bdd584d0c883bec6d9d7dc773/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:48.781088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.811638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:48.816782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:48.828034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323bb2e9-590a-4bdd-b4a7-ea3c563a3f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.829077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb2e9-590a-4bdd-b4a7-ea3c563a3f95 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.830753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb2e9-590a-4bdd-b4a7-ea3c563a3f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.833189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323bb2e9-590a-4bdd-b4a7-ea3c563a3f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.853877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb2e9-590a-4bdd-b4a7-ea3c563a3f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.860932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323bb2e9-590a-4bdd-b4a7-ea3c563a3f95 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.872512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1027/2031] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:48.873934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.874237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.874528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.902537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e8619-5aa5-4d68-88c7-b11ab0ddf003 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.907400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] MFA Rules not processed for user `7a22fa0bdd584d0c883bec6d9d7dc773`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:48.909304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:48.909464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.910237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.910524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.910813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.911613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.913362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.930239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1005/2032] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:48.935696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:48.954024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20c03e-c10c-4dee-97a5-46ca460a45b5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:48.962560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d5ae5-4dae-4fa8-a47a-4c3bf7c1f17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:48.963535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5ae5-4dae-4fa8-a47a-4c3bf7c1f17a admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.963964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5ae5-4dae-4fa8-a47a-4c3bf7c1f17a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.964254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5ae5-4dae-4fa8-a47a-4c3bf7c1f17a admin admin] PATH_INFO: `/v3/projects/7edd5b6348804077bd0406c2b8b922dc/users/08cd7b8261f74dfcab197350d58d0c47/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.966591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d5ae5-4dae-4fa8-a47a-4c3bf7c1f17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7edd5b6348804077bd0406c2b8b922dc, user_id=08cd7b8261f74dfcab197350d58d0c47, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:48.969954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d5ae5-4dae-4fa8-a47a-4c3bf7c1f17a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:48.983658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1006/2033] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:48 2022] PUT /identity/v3/projects/7edd5b6348804077bd0406c2b8b922dc/users/08cd7b8261f74dfcab197350d58d0c47/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:48.994735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:48.995033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:48.995336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:48.999645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1028/2034] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:49.004579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.015657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33484185-4698-45c2-b1cc-7b4d19cfaaf3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.029744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] MFA Rules not processed for user `08cd7b8261f74dfcab197350d58d0c47`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:49.029920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.132357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1007/2035] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:49.134379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.135073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.135400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.135688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.136961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.139198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.145489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.146908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.178493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1029/2036] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:49 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:49.183653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.265099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4887f-2274-4750-bd63-f4a62bc12b70 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.276740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc644a9-33c0-450f-ae20-d2c3edaddd7f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.289040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.289945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.290236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.290542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.291214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.293256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.305241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:49.308944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:49.324755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1030/2037] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:49 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:49.324755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.325027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.338945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2b254-b7e5-40f5-86df-c366b36aae6e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.344579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.345547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.345840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.347563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] PATH_INFO: `/v3/projects/231c5160113b477a931c2e1347e50cda` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.350230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=231c5160113b477a931c2e1347e50cda)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.354949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.361958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.362953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.363446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.363860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.440746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231c5160113b477a931c2e1347e50cda', 'request_id': 'req-7e54b063-1c7f-4e01-a6ae-f8462a953f50'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:49.460889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231c5160113b477a931c2e1347e50cda', 'request_id': 'req-7e54b063-1c7f-4e01-a6ae-f8462a953f50'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:49.476943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231c5160113b477a931c2e1347e50cda', 'request_id': 'req-7e54b063-1c7f-4e01-a6ae-f8462a953f50'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:49.487733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.492845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.503861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] The token cache is being invalidate because project 231c5160113b477a931c2e1347e50cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:49.504096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:49.507012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:49.509714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1031/2038] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:49 2022] DELETE /identity/v3/projects/231c5160113b477a931c2e1347e50cda => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:49.514947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1008/2039] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:49.516773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.518364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.520526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.542230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3660c6f-4518-4b8e-ad6d-c13dafcfca2b service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.628611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54b063-1c7f-4e01-a6ae-f8462a953f50 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.632690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.633434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.633791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.634080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.635967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.638038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36dcfea-0fca-4dd7-a244-23e1870e5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.638959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dcfea-0fca-4dd7-a244-23e1870e5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.639380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dcfea-0fca-4dd7-a244-23e1870e5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.639669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36dcfea-0fca-4dd7-a244-23e1870e5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.640440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dcfea-0fca-4dd7-a244-23e1870e5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.642063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36dcfea-0fca-4dd7-a244-23e1870e5b5f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.666984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1009/2040] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:49.669650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.670451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.671362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.694449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:49.695794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.704540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1010/2041] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:49.710863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.711616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.720275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.721783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.725703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680cad1-8e30-42ac-84c3-c90b52e46b4a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.731207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.731365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1032/2042] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:49.732008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.733314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.735570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.739624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.740916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.744772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.754547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13380f07-3f7d-4704-981e-5efae9cd78a6 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.759394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65390f7d-7efe-43d3-9a28-7cc6c26b91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.760292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390f7d-7efe-43d3-9a28-7cc6c26b91d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.760580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390f7d-7efe-43d3-9a28-7cc6c26b91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.760864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65390f7d-7efe-43d3-9a28-7cc6c26b91d3 admin admin] PATH_INFO: `/v3/projects/358a9d6d70d04ed8b1fbb3cf956207fc/users/87d2906ba30f4ee7b8b1841076d69f03/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.777245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65390f7d-7efe-43d3-9a28-7cc6c26b91d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358a9d6d70d04ed8b1fbb3cf956207fc, user_id=87d2906ba30f4ee7b8b1841076d69f03, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.780054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65390f7d-7efe-43d3-9a28-7cc6c26b91d3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.796661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1033/2043] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:49 2022] PUT /identity/v3/projects/358a9d6d70d04ed8b1fbb3cf956207fc/users/87d2906ba30f4ee7b8b1841076d69f03/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:49.800885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.801188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.801499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.820903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:49.822168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:49.826401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:49.827863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.829420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.853140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1011/2044] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:49.854096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.869204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cce582-c8d0-4378-814a-8c22910e3016 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.875044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:49.906709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1034/2045] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:49.912137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.927250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5166c6-2380-4956-9604-ecc001dc35dd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.939186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.940924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.941638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.942311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.949778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.950535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.950827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.951176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.951925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.953828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.955201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:49.955721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.957870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:49.965537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1012/2046] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:49.969749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.975478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1035/2047] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:49.977024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:49.988245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb1ee-daa9-4de8-839c-f87b16441cae admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.990105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67b3c6-a618-4bcf-9456-0bce18b4df87 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:49.993561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf67e94-43b8-427b-b7c6-93e4b75d0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.994725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67e94-43b8-427b-b7c6-93e4b75d0697 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:49.995013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67e94-43b8-427b-b7c6-93e4b75d0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:49.995289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf67e94-43b8-427b-b7c6-93e4b75d0697 admin admin] PATH_INFO: `/v3/projects/358a9d6d70d04ed8b1fbb3cf956207fc/users/87d2906ba30f4ee7b8b1841076d69f03/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:49.998125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf67e94-43b8-427b-b7c6-93e4b75d0697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358a9d6d70d04ed8b1fbb3cf956207fc, user_id=87d2906ba30f4ee7b8b1841076d69f03, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:49.998454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:49.999885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.000230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.000526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.001205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf67e94-43b8-427b-b7c6-93e4b75d0697 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.004363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.007602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.017304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1013/2048] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:49 2022] PUT /identity/v3/projects/358a9d6d70d04ed8b1fbb3cf956207fc/users/87d2906ba30f4ee7b8b1841076d69f03/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:50.028570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.029266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.032349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.047881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1036/2049] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:49 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:47:50.052568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:50.080749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] MFA Rules not processed for user `87d2906ba30f4ee7b8b1841076d69f03`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:50.082054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:50.142602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84c271-566c-43dc-a14d-b95a48c66c93 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:50.150101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:50.150916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.151418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.151708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.152416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.154394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.179442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1014/2050] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:50.190682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1037/2051] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:50 2022] POST /identity/v3/users => generated 285 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:50.194357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:50.207576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ac48a-0867-4ca3-b7db-984e3b14bb9b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:50.213375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:50.214048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.214326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.214611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.215882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.217939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.237647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1015/2052] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:50.239595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:50.266908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3129f-6cf2-4f60-9ab2-808077be09db admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:50.277458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bd49f-9d90-4bfe-8fdc-c4c573d4a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:50.278150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd49f-9d90-4bfe-8fdc-c4c573d4a8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.278441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd49f-9d90-4bfe-8fdc-c4c573d4a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.278783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd49f-9d90-4bfe-8fdc-c4c573d4a8c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.279481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bd49f-9d90-4bfe-8fdc-c4c573d4a8c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.281733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97bd49f-9d90-4bfe-8fdc-c4c573d4a8c4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.303371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1038/2053] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:50.305194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:50.316882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c454d-18af-46c4-80ac-401e505374dc admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:50.341541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:50.345300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.346775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.347394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] PATH_INFO: `/v3/projects/3dde028411c0494586fbaa3f1563010d/users/8196df6e7c8e406f81d38e08b181cd16/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.372506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dde028411c0494586fbaa3f1563010d, user_id=8196df6e7c8e406f81d38e08b181cd16, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.376034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.404684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1016/2054] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:50 2022] PUT /identity/v3/projects/3dde028411c0494586fbaa3f1563010d/users/8196df6e7c8e406f81d38e08b181cd16/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:50.417278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.417579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.417891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.467623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] MFA Rules not processed for user `8196df6e7c8e406f81d38e08b181cd16`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:50.467623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:50.467807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:50.523191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:50.527571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:50.542914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276a975-8270-4aa8-8040-eb61b3c885c4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:50.548375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:50.549694 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.550058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.550700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.553456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:50.566994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1039/2055] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:50.597104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:50.602186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:50.686604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.688802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.719918 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1017/2056] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:50.773453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029b979-5b5b-41a6-a97b-65a05e52c69f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:50.778568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:50.779598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:50.779598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:50.779841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:50.795746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:50.797446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:50.824778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1040/2057] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:51.355032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:51.365385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3a0b-3ba8-4733-8ca2-3d40a320c7c6 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:51.369666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:51.370266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:51.370610 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:51.370808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:51.372655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:51.449875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:51.451366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:51.462701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1018/2058] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:53.690296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:53.790885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70c6d9-e087-4cd5-9a12-dee9a2055339 service glance] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:53.795982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:53.798774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:53.800422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:53.808704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:53.808704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:53.808704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] PATH_INFO: `/v3/users/7a22fa0bdd584d0c883bec6d9d7dc773` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:53.815033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a22fa0bdd584d0c883bec6d9d7dc773)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:53.820086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:53.841784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18568234-72af-49d8-bd75-991679e49bf6 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:53.860141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:53.862066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:53.862364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:53.862691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] PATH_INFO: `/v3/users/83bae636b53b4a209f780d73767f1668` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:53.864299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83bae636b53b4a209f780d73767f1668)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:53.868396 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:53.951196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a22fa0bdd584d0c883bec6d9d7dc773'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:53.980022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a22fa0bdd584d0c883bec6d9d7dc773'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:53.991130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a22fa0bdd584d0c883bec6d9d7dc773'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:53.992797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a22fa0bdd584d0c883bec6d9d7dc773'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:53.994577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-79750172-98b5-4d21-9ec8-220dd40d4031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a22fa0bdd584d0c883bec6d9d7dc773'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:54.009569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83bae636b53b4a209f780d73767f1668'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:54.011355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83bae636b53b4a209f780d73767f1668'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:54.022004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1041/2059] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:53 2022] DELETE /identity/v3/users/7a22fa0bdd584d0c883bec6d9d7dc773 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:54.027528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:54.027936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:54.028581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83bae636b53b4a209f780d73767f1668'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:54.028727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:54.029661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83bae636b53b4a209f780d73767f1668'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:54.037820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:54.050286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-67015540-b73c-4e17-999f-f2f6caa4291a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83bae636b53b4a209f780d73767f1668'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:54.052509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:54.054011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:54.072978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1019/2060] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:53 2022] DELETE /identity/v3/users/83bae636b53b4a209f780d73767f1668 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:54.076040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:54.076501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:54.077003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:54.085587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:54.106716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:54.109411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:54.147244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1042/2061] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:54.216790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1020/2062] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:54.395516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:54.395721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:54.397312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:54.397985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:54.525678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9f6c8-a8b8-4c8e-94d9-126bbbaec818 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:54.530526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:54.531303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:54.531633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:54.531911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:54.539857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581b428-f7c0-4fa5-ac59-d204b33183b0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:54.547237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:54.549345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:54.550301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:54.550435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:54.550435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:54.550591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:54.571342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1043/2063] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:54.581261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:54.582962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:54.602511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1021/2064] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:55.334776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:55.336496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:55.360026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9f22a5-7539-463d-a6b2-1caa51c89eb4 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:55.366932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:55.368092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:55.369335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:55.369845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] PATH_INFO: `/v3/projects/621bc0c8a5da40a09755cc47d1bcf924` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:55.371264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=621bc0c8a5da40a09755cc47d1bcf924)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:55.373712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:55.432013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621bc0c8a5da40a09755cc47d1bcf924', 'request_id': 'req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.440422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621bc0c8a5da40a09755cc47d1bcf924', 'request_id': 'req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.448721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621bc0c8a5da40a09755cc47d1bcf924', 'request_id': 'req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.462543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] The token cache is being invalidate because project 621bc0c8a5da40a09755cc47d1bcf924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:55.462838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.463559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.465622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1044/2065] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:55 2022] DELETE /identity/v3/projects/621bc0c8a5da40a09755cc47d1bcf924 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:55.469997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:55.481890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872181d-0e38-4384-beb4-e36c2a85bb23 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:55.547427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:55.547427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:55.547427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:55.547919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] PATH_INFO: `/v3/users/87d2906ba30f4ee7b8b1841076d69f03` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:55.551598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87d2906ba30f4ee7b8b1841076d69f03)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:55.554340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:55.570478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:55.575103 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:55.630061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80448c-34f5-44ad-b4ff-3f68acfdd36d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:55.636057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:55.636560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:55.636850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:55.637123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] PATH_INFO: `/v3/projects/b6e0abb79734469ab3c1ee2910e2bfe2` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:55.638370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e0abb79734469ab3c1ee2910e2bfe2)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:55.640366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:55.647286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87d2906ba30f4ee7b8b1841076d69f03'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.649642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87d2906ba30f4ee7b8b1841076d69f03'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.651747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:55.676466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87d2906ba30f4ee7b8b1841076d69f03'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.677022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87d2906ba30f4ee7b8b1841076d69f03'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.701878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87d2906ba30f4ee7b8b1841076d69f03'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.714284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:55.726019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1022/2066] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:55 2022] DELETE /identity/v3/users/87d2906ba30f4ee7b8b1841076d69f03 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:55.766423 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e0abb79734469ab3c1ee2910e2bfe2', 'request_id': 'req-4daaaa4f-6496-4f4b-871d-81c312635a1e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.774682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e0abb79734469ab3c1ee2910e2bfe2', 'request_id': 'req-4daaaa4f-6496-4f4b-871d-81c312635a1e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.792331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e0abb79734469ab3c1ee2910e2bfe2', 'request_id': 'req-4daaaa4f-6496-4f4b-871d-81c312635a1e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.832297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] The token cache is being invalidate because project b6e0abb79734469ab3c1ee2910e2bfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:55.832609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.834209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:55.840234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1045/2067] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:55 2022] DELETE /identity/v3/projects/b6e0abb79734469ab3c1ee2910e2bfe2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:55.844252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:55.849153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:55.920044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:55.922692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:55.996474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46aa0c-7647-4232-822d-af8b3bccd170 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:56.065182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daaaa4f-6496-4f4b-871d-81c312635a1e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:56.076354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:56.077778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.078916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.079208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] PATH_INFO: `/v3/users/20d1019fff884ec9bc616b03388cfcf5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.080718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d1019fff884ec9bc616b03388cfcf5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:56.086337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:56.127433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:56.128711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.128996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.129877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] PATH_INFO: `/v3/users/08cd7b8261f74dfcab197350d58d0c47` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.130943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cd7b8261f74dfcab197350d58d0c47)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:56.136596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:56.207535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d1019fff884ec9bc616b03388cfcf5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.234652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d1019fff884ec9bc616b03388cfcf5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.248297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cd7b8261f74dfcab197350d58d0c47'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.249454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cd7b8261f74dfcab197350d58d0c47'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.263033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cd7b8261f74dfcab197350d58d0c47'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.264338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cd7b8261f74dfcab197350d58d0c47'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.266732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d1019fff884ec9bc616b03388cfcf5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.275806 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d1019fff884ec9bc616b03388cfcf5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.278616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d1019fff884ec9bc616b03388cfcf5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.291156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0ffe4e9c-8e2c-4733-9d33-15b7a8f60b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cd7b8261f74dfcab197350d58d0c47'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.293670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:56.311870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1046/2068] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:55 2022] DELETE /identity/v3/users/20d1019fff884ec9bc616b03388cfcf5 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:56.312803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:56.317689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:56.338633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1023/2069] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:55 2022] DELETE /identity/v3/users/08cd7b8261f74dfcab197350d58d0c47 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:56.341202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.341506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.344471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.372473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:56.372473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:56.407384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:56.464055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1024/2070] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:56.482593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e222b-4301-4e4e-b82e-e9c3eab57745 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:56.492748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:56.493811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.494157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.502069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:56.502605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] PATH_INFO: `/v3/users/314cd5bcba0741deb191dcd45e475f83` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.504448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:56.504856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=314cd5bcba0741deb191dcd45e475f83)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:56.510224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:56.612172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '314cd5bcba0741deb191dcd45e475f83'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.632232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '314cd5bcba0741deb191dcd45e475f83'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.637785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f51774-f186-4b0c-9f6f-0584ceb7e771 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:56.641500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '314cd5bcba0741deb191dcd45e475f83'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.643817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '314cd5bcba0741deb191dcd45e475f83'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.644994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-031e10c1-143b-4a4d-a4ae-aa498125c3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '314cd5bcba0741deb191dcd45e475f83'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:56.645844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:56.646734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.647172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.648211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.651851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:56.667865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1047/2071] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:56 2022] DELETE /identity/v3/users/314cd5bcba0741deb191dcd45e475f83 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:56.671312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916057d0-2a96-4208-8ac9-873956de758c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.671755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916057d0-2a96-4208-8ac9-873956de758c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.673327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916057d0-2a96-4208-8ac9-873956de758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.676607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:56.682172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:56.696689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1025/2072] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:56.707183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-916057d0-2a96-4208-8ac9-873956de758c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:56.709270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-916057d0-2a96-4208-8ac9-873956de758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:56.812483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1048/2073] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:56.829462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:56.832522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:56.848959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e3f45-4157-44c9-8585-14646a3a544b service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:56.935349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e350320-a964-49b9-9b9e-34ac13a3ccfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:56.936028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350320-a964-49b9-9b9e-34ac13a3ccfc service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:56.936611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350320-a964-49b9-9b9e-34ac13a3ccfc service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:56.936900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e350320-a964-49b9-9b9e-34ac13a3ccfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:56.949531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350320-a964-49b9-9b9e-34ac13a3ccfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:56.951492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e350320-a964-49b9-9b9e-34ac13a3ccfc service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:56.966877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1026/2074] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:57.039201 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916057d0-2a96-4208-8ac9-873956de758c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.041139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-916057d0-2a96-4208-8ac9-873956de758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.067069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916057d0-2a96-4208-8ac9-873956de758c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.075284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.077222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.077649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.078328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] PATH_INFO: `/v3/projects/358a9d6d70d04ed8b1fbb3cf956207fc` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.081378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] RBAC: Authorizing `identity:delete_project(project_id=358a9d6d70d04ed8b1fbb3cf956207fc)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.087555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.175542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:57.177505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358a9d6d70d04ed8b1fbb3cf956207fc', 'request_id': 'req-bf9427e5-7076-42af-97f2-b8c149ee529e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.187961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358a9d6d70d04ed8b1fbb3cf956207fc', 'request_id': 'req-bf9427e5-7076-42af-97f2-b8c149ee529e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.202503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358a9d6d70d04ed8b1fbb3cf956207fc', 'request_id': 'req-bf9427e5-7076-42af-97f2-b8c149ee529e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.215924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] The token cache is being invalidate because project 358a9d6d70d04ed8b1fbb3cf956207fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:57.216672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.218334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.219940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1049/2075] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:57 2022] DELETE /identity/v3/projects/358a9d6d70d04ed8b1fbb3cf956207fc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:57.224864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d410567-a325-4553-833c-b6b628011b36 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.225399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d410567-a325-4553-833c-b6b628011b36 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.225859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d410567-a325-4553-833c-b6b628011b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.255798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7d410567-a325-4553-833c-b6b628011b36 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:57.257149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7d410567-a325-4553-833c-b6b628011b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.304594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:57.329165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.332125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.389721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1027/2076] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:57.390765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d410567-a325-4553-833c-b6b628011b36 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.397763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7d410567-a325-4553-833c-b6b628011b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.418345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d410567-a325-4553-833c-b6b628011b36 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.424742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.425807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.426237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.426660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] PATH_INFO: `/v3/projects/b9afe0608615425c9b63acc9b96a9675` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.428108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9afe0608615425c9b63acc9b96a9675)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.430025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.456301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9427e5-7076-42af-97f2-b8c149ee529e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.461432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.462314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.462781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.462890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] PATH_INFO: `/v3/projects/7edd5b6348804077bd0406c2b8b922dc` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.464086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7edd5b6348804077bd0406c2b8b922dc)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.466299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.492628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9afe0608615425c9b63acc9b96a9675', 'request_id': 'req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.499995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9afe0608615425c9b63acc9b96a9675', 'request_id': 'req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.509828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9afe0608615425c9b63acc9b96a9675', 'request_id': 'req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.534101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] The token cache is being invalidate because project b9afe0608615425c9b63acc9b96a9675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:57.534417 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.535777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c6f4ded-ee2e-4556-bfd5-6fa19104eab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.540187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1028/2077] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:57 2022] DELETE /identity/v3/projects/b9afe0608615425c9b63acc9b96a9675 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:57.542959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.543445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.543827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.546303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7edd5b6348804077bd0406c2b8b922dc', 'request_id': 'req-a7ace92a-36fa-416f-aea8-6b3e4e32b668'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.564127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7edd5b6348804077bd0406c2b8b922dc', 'request_id': 'req-a7ace92a-36fa-416f-aea8-6b3e4e32b668'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.572550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7edd5b6348804077bd0406c2b8b922dc', 'request_id': 'req-a7ace92a-36fa-416f-aea8-6b3e4e32b668'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.574892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:57.577155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.586461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] The token cache is being invalidate because project 7edd5b6348804077bd0406c2b8b922dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:57.586854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.587846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.593149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1050/2078] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:57 2022] DELETE /identity/v3/projects/7edd5b6348804077bd0406c2b8b922dc => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:57.593149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.593149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.654616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1029/2079] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:57.655607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.659023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.670877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74585c39-abeb-4139-a9cb-f7fc88dd4115 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.676493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.679651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace92a-36fa-416f-aea8-6b3e4e32b668 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.680205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.680510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.680938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] PATH_INFO: `/v3/projects/a5b2ff80c04e44f89234cb880670f2fc` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.686149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b2ff80c04e44f89234cb880670f2fc)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.688424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.689622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.690678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.691270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.691410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] PATH_INFO: `/v3/users/666b50a6d8da49b3ac03f161885505ca` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.692787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666b50a6d8da49b3ac03f161885505ca)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.694870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.700800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:57.754786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b2ff80c04e44f89234cb880670f2fc', 'request_id': 'req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.758963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666b50a6d8da49b3ac03f161885505ca'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.760849 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:57.762086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b2ff80c04e44f89234cb880670f2fc', 'request_id': 'req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.770947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b2ff80c04e44f89234cb880670f2fc', 'request_id': 'req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.774817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666b50a6d8da49b3ac03f161885505ca'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.788254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666b50a6d8da49b3ac03f161885505ca'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.789048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666b50a6d8da49b3ac03f161885505ca'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.790254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666b50a6d8da49b3ac03f161885505ca'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.791873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] The token cache is being invalidate because project a5b2ff80c04e44f89234cb880670f2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:57.792330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.793118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ea5abb8d-7d13-4e56-a707-7e8da29f44ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.796640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1030/2080] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:57 2022] DELETE /identity/v3/projects/a5b2ff80c04e44f89234cb880670f2fc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:57.796640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.796640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.797077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.808010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1051/2081] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:57 2022] DELETE /identity/v3/users/666b50a6d8da49b3ac03f161885505ca => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:57.812189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.813554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.817984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:57.819156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.894196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944626-9e21-4b05-ad3e-b7ee750c6770 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.895483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1031/2082] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:57.902801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.902801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.907196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.908219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.908506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.908853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.909538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:57.909933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.911809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f266a4bc-d73a-4781-b972-bed7a29fb80f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.913916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a369c62-0dcc-47a0-ba7e-cffe9459ec82 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.919780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.920819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.921205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.921573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] PATH_INFO: `/v3/users/a89e89f2ab394472b90ab78c4690cce4` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.923071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89e89f2ab394472b90ab78c4690cce4)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.926299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:57.934402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1052/2083] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:57.935615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.936057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.936346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.958371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:57.959907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.969816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1053/2084] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:57.971446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:57.972747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:57.984797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730652ad-1cd5-41d4-bcfc-2a8cef2638d6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:57.990059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:57.990824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:57.991365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:57.991574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89e89f2ab394472b90ab78c4690cce4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.991670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:57.992010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89e89f2ab394472b90ab78c4690cce4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:57.992276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:57.994933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.025818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89e89f2ab394472b90ab78c4690cce4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:58.026587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89e89f2ab394472b90ab78c4690cce4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:58.053150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1054/2085] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:57 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:58.053150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.053150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.058160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89e89f2ab394472b90ab78c4690cce4'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:58.076073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1032/2086] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:57 2022] DELETE /identity/v3/users/a89e89f2ab394472b90ab78c4690cce4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:58.077621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.079338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.118238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:58.134514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408cdb-0314-40d8-ac4c-88822cd71911 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.179148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:58.183962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c4bc6-8d24-40b5-aa52-a6ccc3309b50 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.193695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.194964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.195500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.196066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.197055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.199376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.224635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.225307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.225594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.225868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.226754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:58.227204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.228957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.239372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1033/2087] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:58 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:58.241444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.243660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1055/2088] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:58.248368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.255539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e43e1-aba5-4d3a-aa01-fc9b74aeaca3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.261101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.261790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.262079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.262364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.263093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.264824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.271670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9b461-d91f-4a91-a550-91eb6b805781 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.277089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.277757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.278190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.278475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.279178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.281282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.281763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1034/2089] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:58.283687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.296999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f64931-5248-4dd4-84c3-a97751b9b7e8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.304763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.306901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.306901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.306901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.306901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.309318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.317119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1056/2090] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:58 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:58.321329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.331369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1035/2091] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:58.335639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.348065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a90397-93b7-47f8-a8fa-eccd7fa804d2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.400328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebc965-bca5-45c4-b943-a936b3e3f529 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.405261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.405719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.406101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.406462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.408231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.410174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.426122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeace73-5050-422a-a0fb-1a025bfe10a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.427388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeace73-5050-422a-a0fb-1a025bfe10a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.427934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeace73-5050-422a-a0fb-1a025bfe10a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.428199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeace73-5050-422a-a0fb-1a025bfe10a7 admin admin] PATH_INFO: `/v3/projects/01eac658fce742efb165e10f90f3fb21/users/c63ca096bb46450fa4a8c7f7c66a366a/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.438526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1057/2092] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:58 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:58.442748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.451356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeace73-5050-422a-a0fb-1a025bfe10a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01eac658fce742efb165e10f90f3fb21, user_id=c63ca096bb46450fa4a8c7f7c66a366a, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.454490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeace73-5050-422a-a0fb-1a025bfe10a7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.467006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da913bc4-88d4-46af-b9b4-adea6966b056 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.474130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.475212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.475600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.475985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.476775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.479350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1036/2093] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:58 2022] PUT /identity/v3/projects/01eac658fce742efb165e10f90f3fb21/users/c63ca096bb46450fa4a8c7f7c66a366a/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:58.479499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.489779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.490065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.490480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.501515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1058/2094] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:58.502669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.514160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d4dee-a1fe-49e9-a9c5-d60eabb0a8ba admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.520534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] MFA Rules not processed for user `c63ca096bb46450fa4a8c7f7c66a366a`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:58.521477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.576278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:58.593169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.594189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.594554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.594909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.596315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.598032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.612493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1037/2095] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:47:58.612716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1059/2096] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:47:58.614017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.619592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.621376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.626550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d100b6-112b-43b6-a838-f76c9ef0f8c7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.633823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c3ce5-9951-46e0-bbe6-5c2afd4eac56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.634916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3ce5-9951-46e0-bbe6-5c2afd4eac56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.635306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3ce5-9951-46e0-bbe6-5c2afd4eac56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.635712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c3ce5-9951-46e0-bbe6-5c2afd4eac56 admin admin] PATH_INFO: `/v3/projects/f02531ef241549669d346cf66f95d86c/users/e59a84e92f5a481fa1f41949de5ab0bc/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.653831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c3ce5-9951-46e0-bbe6-5c2afd4eac56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02531ef241549669d346cf66f95d86c, user_id=e59a84e92f5a481fa1f41949de5ab0bc, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.656967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c3ce5-9951-46e0-bbe6-5c2afd4eac56 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.675796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1038/2097] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:58 2022] PUT /identity/v3/projects/f02531ef241549669d346cf66f95d86c/users/e59a84e92f5a481fa1f41949de5ab0bc/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:58.686529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.687043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.687571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.715281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:58.719474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] MFA Rules not processed for user `e59a84e92f5a481fa1f41949de5ab0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:58.723541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.731946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f50d0-16cf-4a0e-b551-7d18ac44767e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.804841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.805368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.805654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.805934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.810740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1039/2098] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:58.811648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.813185 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.882189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.883696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.895289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1060/2099] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:47:58.895999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.903880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c00df-04c3-4735-8987-6f8d39c3492b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.909506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbcecc-35dd-455f-b77e-279d0f37e180 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:58.910410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.912105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.912547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.913003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] PATH_INFO: `/v3/projects/74385b703f594b1ca43299967e0a0029` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.914214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74385b703f594b1ca43299967e0a0029)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.915810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:58.916728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:58.917102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:58.917491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:58.918424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:58.920922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.922983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:58.956797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1061/2100] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:58 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:58.957759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:58.960861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:58.994899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74385b703f594b1ca43299967e0a0029', 'request_id': 'req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.000867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74385b703f594b1ca43299967e0a0029', 'request_id': 'req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.001853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:59.008756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74385b703f594b1ca43299967e0a0029', 'request_id': 'req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.023436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] The token cache is being invalidate because project 74385b703f594b1ca43299967e0a0029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:59.023733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.024636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.026190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1040/2101] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:58 2022] DELETE /identity/v3/projects/74385b703f594b1ca43299967e0a0029 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:59.026962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.028757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.045663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d650839-c572-4b76-b424-51757a121d2b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.073943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:59.117934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.118817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.119100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.119420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] PATH_INFO: `/v3/projects/13c321ceca7141a593e3a056d72817e7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.120630 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c321ceca7141a593e3a056d72817e7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.122686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.132012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b709f2-aef2-4517-87f6-b76e8b9dc8a7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.137298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.138055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.138409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.138753 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.139552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.141538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.170844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1041/2102] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:47:59 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:59.172469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.177455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.202462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c321ceca7141a593e3a056d72817e7', 'request_id': 'req-e60d8666-f1f3-46a6-9015-cddfa3fb7741'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.207005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc75da3-7ec9-4458-a00b-51927cfb6660 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.209488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c321ceca7141a593e3a056d72817e7', 'request_id': 'req-e60d8666-f1f3-46a6-9015-cddfa3fb7741'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.218657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c321ceca7141a593e3a056d72817e7', 'request_id': 'req-e60d8666-f1f3-46a6-9015-cddfa3fb7741'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.233416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] The token cache is being invalidate because project 13c321ceca7141a593e3a056d72817e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:47:59.233779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.234507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.240734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1062/2103] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:58 2022] DELETE /identity/v3/projects/13c321ceca7141a593e3a056d72817e7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:59.240734 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.242046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.271832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.273087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.273752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.274240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] PATH_INFO: `/v3/users/c63ca096bb46450fa4a8c7f7c66a366a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.275758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63ca096bb46450fa4a8c7f7c66a366a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.278301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.320322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d8666-f1f3-46a6-9015-cddfa3fb7741 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.325604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.326498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.326793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.327074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] PATH_INFO: `/v3/users/f0b0defe98744fec842b062d4fbf5ed3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.328605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b0defe98744fec842b062d4fbf5ed3)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.331152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.336212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63ca096bb46450fa4a8c7f7c66a366a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.336946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63ca096bb46450fa4a8c7f7c66a366a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.344011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63ca096bb46450fa4a8c7f7c66a366a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.344365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:59.345082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63ca096bb46450fa4a8c7f7c66a366a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.361146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63ca096bb46450fa4a8c7f7c66a366a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.375253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1042/2104] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:59 2022] DELETE /identity/v3/users/c63ca096bb46450fa4a8c7f7c66a366a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:59.376205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.377662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.382010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b0defe98744fec842b062d4fbf5ed3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.395148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b0defe98744fec842b062d4fbf5ed3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.401987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b0defe98744fec842b062d4fbf5ed3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.402719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b0defe98744fec842b062d4fbf5ed3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.403354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-86925cd1-bfa3-41f3-8b49-0f326f6a184a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b0defe98744fec842b062d4fbf5ed3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:47:59.417156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1063/2105] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:47:59 2022] DELETE /identity/v3/users/f0b0defe98744fec842b062d4fbf5ed3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:59.418444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3671b-5f53-412e-81d4-7828c28dd145 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.418735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3671b-5f53-412e-81d4-7828c28dd145 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.419019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3671b-5f53-412e-81d4-7828c28dd145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.432697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:59.442482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-aea3671b-5f53-412e-81d4-7828c28dd145 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:59.443838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-aea3671b-5f53-412e-81d4-7828c28dd145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.460210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29fdf7-40da-4856-94e8-069339bae44b admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.528330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1064/2106] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:59.529852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac964-8b9f-4bc5-95e4-84d031cb3a9a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.530295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac964-8b9f-4bc5-95e4-84d031cb3a9a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.530676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac964-8b9f-4bc5-95e4-84d031cb3a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.554968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.556340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.557023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.557446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.558422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.558864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-024ac964-8b9f-4bc5-95e4-84d031cb3a9a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:59.560232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-024ac964-8b9f-4bc5-95e4-84d031cb3a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.560618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.569191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1065/2107] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:59.570605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.571021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.571433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.573586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1043/2108] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:59.578027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.580716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.595121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:59.597094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.597259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e454a-6498-4195-92b2-df3fde83fcb2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.602774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.603680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.604215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.604770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.605782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.607141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1066/2109] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:47:59.608095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.611115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.621912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1044/2110] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:47:59.628994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.632333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fc821-8ee0-482d-a213-34a7f7e802df None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.638955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.639853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.640073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.640475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.641479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:47:59.642949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.646833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.647177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e1e6f-ab51-4459-a0dd-8fdb152d6856 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.656439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.657531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.658690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.659637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] PATH_INFO: `/v3/projects/cea046e537c145b48764e899ac5891ae/users/dc3f3154faa94e2d9e59f27b2f603732/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.677709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1067/2111] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:47:59.681024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.683608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.686532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea046e537c145b48764e899ac5891ae, user_id=dc3f3154faa94e2d9e59f27b2f603732, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.690688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.715871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1045/2112] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:47:59 2022] PUT /identity/v3/projects/cea046e537c145b48764e899ac5891ae/users/dc3f3154faa94e2d9e59f27b2f603732/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:47:59.715871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.807216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d2880-c7a0-4ac5-8f08-45e7034d810b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.838697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:47:59.858238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67ed4d-6f8e-448c-9302-6af6b3489184 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.864065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb890b2-5997-487d-a1bb-b204ce8558d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.865093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb890b2-5997-487d-a1bb-b204ce8558d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.865590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb890b2-5997-487d-a1bb-b204ce8558d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.866112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb890b2-5997-487d-a1bb-b204ce8558d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.867117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb890b2-5997-487d-a1bb-b204ce8558d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.869212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb890b2-5997-487d-a1bb-b204ce8558d4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.897455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:47:59.898184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.898482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.898899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.910351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:47:59.912187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:47:59.913448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1046/2113] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:47:59 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:47:59.915499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:47:59.916028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:47:59.916549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:47:59.932617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1068/2114] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:47:59.933835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:47:59.935931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:47:59.955251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3987c-9d09-4d8d-82a3-b4290be886a3 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:47:59.974573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] MFA Rules not processed for user `dc3f3154faa94e2d9e59f27b2f603732`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:47:59.976954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.032573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.043696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.045290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.045986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.046281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] PATH_INFO: `/v3/projects/843d167a469d4b77a290bf3cbf2cfcbe` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.048569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=843d167a469d4b77a290bf3cbf2cfcbe)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.052083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.105341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1047/2115] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:47:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:00.106470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.122672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843d167a469d4b77a290bf3cbf2cfcbe', 'request_id': 'req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.126059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9900c-d5f6-421d-a335-726feea1a553 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.131121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843d167a469d4b77a290bf3cbf2cfcbe', 'request_id': 'req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.159268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843d167a469d4b77a290bf3cbf2cfcbe', 'request_id': 'req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.186379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] The token cache is being invalidate because project 843d167a469d4b77a290bf3cbf2cfcbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:00.186731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.187496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.189809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1069/2116] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:47:59 2022] DELETE /identity/v3/projects/843d167a469d4b77a290bf3cbf2cfcbe => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:00.190619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.192269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.265965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3a928-9b62-4621-bcdf-4d0293dd9534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.267969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3a928-9b62-4621-bcdf-4d0293dd9534 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.268467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3a928-9b62-4621-bcdf-4d0293dd9534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.269148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3a928-9b62-4621-bcdf-4d0293dd9534 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.270293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3a928-9b62-4621-bcdf-4d0293dd9534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.273696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3a928-9b62-4621-bcdf-4d0293dd9534 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.297788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.319776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1048/2117] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:00.321780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.322179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.324850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.367308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05316df-2b29-4999-bb07-ffeb0fc1ea0f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.372679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.373367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.373652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.373937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.374697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.376869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.378175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:00.385218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.396912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1049/2118] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:00.399012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.404304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.419360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1070/2119] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:00.419360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.420380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.421440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79cadd-a9b0-462e-ac28-59d08db2ed5e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.501989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d4caf-d663-4453-acc5-9fcc5e7637a4 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.507166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.508114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.508382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.508836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] PATH_INFO: `/v3/projects/01eac658fce742efb165e10f90f3fb21` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.510239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01eac658fce742efb165e10f90f3fb21)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.511741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8fe236-db84-41c1-a91d-23ddb0fa586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.512471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.512589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe236-db84-41c1-a91d-23ddb0fa586a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.512774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe236-db84-41c1-a91d-23ddb0fa586a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.513055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8fe236-db84-41c1-a91d-23ddb0fa586a admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.513980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fe236-db84-41c1-a91d-23ddb0fa586a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.515483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8fe236-db84-41c1-a91d-23ddb0fa586a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.529230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1050/2120] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:00.529230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.529230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.529230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.557076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:00.558207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.571735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01eac658fce742efb165e10f90f3fb21', 'request_id': 'req-e37f7896-5739-4ec5-a494-2a4a868a32a7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.578026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01eac658fce742efb165e10f90f3fb21', 'request_id': 'req-e37f7896-5739-4ec5-a494-2a4a868a32a7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.591571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01eac658fce742efb165e10f90f3fb21', 'request_id': 'req-e37f7896-5739-4ec5-a494-2a4a868a32a7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.604319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] The token cache is being invalidate because project 01eac658fce742efb165e10f90f3fb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:00.604785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.604925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.605616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:00.611418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1071/2121] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:00 2022] DELETE /identity/v3/projects/01eac658fce742efb165e10f90f3fb21 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:00.611418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.611418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.631913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1051/2122] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:00.632783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.634064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.646018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc26767-f99f-488c-86e8-10bb6e29d5e3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.651286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eadedd-2cc9-4edb-a65d-ff9628987c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.651986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eadedd-2cc9-4edb-a65d-ff9628987c86 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.652418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eadedd-2cc9-4edb-a65d-ff9628987c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.652732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eadedd-2cc9-4edb-a65d-ff9628987c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.654828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eadedd-2cc9-4edb-a65d-ff9628987c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.656497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eadedd-2cc9-4edb-a65d-ff9628987c86 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.669527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1052/2123] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:00.670887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.671200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.671490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.695194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f7896-5739-4ec5-a494-2a4a868a32a7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.695794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:00.697004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.700503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.701179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.701469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.701750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.702446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.704416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.705887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1053/2124] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:00.706680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.718348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00056a-ccc4-4022-91a2-5d3e36f553ec None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.722192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:00.723938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.724597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.724857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.725127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.725925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:00.726156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.727785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45770101-cc5b-4ee5-b9f2-03ad37872528 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.729951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1072/2125] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:00.731519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.739864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1054/2126] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:00.741016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.741305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.741578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.745243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e576b0-738c-4446-baed-1648fd7ef125 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.751091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.752045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.752336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.752614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] PATH_INFO: `/v3/projects/cbd06e32bc5f4d29bd5abe76c4936f57/users/06cfcad8408a413da42b1e780e659938/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.761100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:00.762440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:00.771565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbd06e32bc5f4d29bd5abe76c4936f57, user_id=06cfcad8408a413da42b1e780e659938, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.772416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1055/2127] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:00.773057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.774445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.784934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bceec5c-d90c-4e8a-8b2d-af6170941398 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.791539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.792221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.792500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.792778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.793622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.795216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.808246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1073/2128] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:00 2022] PUT /identity/v3/projects/cbd06e32bc5f4d29bd5abe76c4936f57/users/06cfcad8408a413da42b1e780e659938/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:00.808246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.816095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1056/2129] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:00.816095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.827796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ef317-ec06-4bde-807e-2fa2e097aafa admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.895690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.896357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.896647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.896929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.897054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eaa2f-7f11-4b1b-9a84-161a784ddac1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:00.897689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:00.898002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.899629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd09636f-6803-4000-a3d8-06bf52a0be66 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.905843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:00.907070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.907404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.907721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.908422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:00.910819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:00.911813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1057/2130] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:00.913593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:00.913700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:00.913958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:00.943761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1074/2131] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:00.943761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:00.945189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] MFA Rules not processed for user `06cfcad8408a413da42b1e780e659938`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:00.946589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.020250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1058/2132] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:01.021129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.033481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffd2e7-8737-43df-860f-58dc1432c182 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.035244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36782625-aa8c-45b2-8cdb-fcb7e633b491 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.038392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.039285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.039706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.039991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] PATH_INFO: `/v3/projects/b84bb496683c48f1ae821d8a38234795/users/c60ee318222c4043bc733b8255154ece/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.040211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.040871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.041161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.041443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.042144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.044138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.057045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84bb496683c48f1ae821d8a38234795, user_id=c60ee318222c4043bc733b8255154ece, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.060674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.067183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:01.079354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1059/2133] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:01.079569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1075/2134] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:00 2022] PUT /identity/v3/projects/b84bb496683c48f1ae821d8a38234795/users/c60ee318222c4043bc733b8255154ece/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:01.080672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.082989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.136795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:01.156469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7660781-2278-4b71-b77e-0a341a3ab0c6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.160417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b22b65-69f2-42a4-a7f1-dd43f244ae4d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.161730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.162470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.162825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.163108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.163835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.165328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.166015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.166298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.166485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.166586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.167250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.169194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.190440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1060/2135] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:01.191351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.201055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f33123-bb7b-49fd-995c-134a57ae4639 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.201563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1076/2136] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:01.202242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.265505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.266316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.267150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.267575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.268214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c73439-0279-47de-9c20-bfb6f9f3949b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.268323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.270339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.272970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.273637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.273924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.274203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.274979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.276737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.290708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1077/2137] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.291676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.299140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1061/2138] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:01.299140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.302180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0f9e-fd48-4f02-aba9-82ead519904c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.310004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9facbc2a-06b4-42b3-ad70-24afec307f67 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.312539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.313147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.313441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.313725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.314489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.318275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.318436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.318546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.318546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.318546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.318546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.319439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.330901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1078/2139] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.330901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.338683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2a4813-28b2-4c85-9d9a-09ba4e83fc5c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.343026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1062/2140] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:01.344029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.346807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.347716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.348621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.348914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] PATH_INFO: `/v3/projects/b84bb496683c48f1ae821d8a38234795/users/c60ee318222c4043bc733b8255154ece/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.350995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84bb496683c48f1ae821d8a38234795, user_id=c60ee318222c4043bc733b8255154ece, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.353754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.356100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b54f640-7d8e-4557-93c3-98911a5c4a06 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.361881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.362906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.363164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.363529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.364457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.366402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.367397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1079/2141] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:01 2022] PUT /identity/v3/projects/b84bb496683c48f1ae821d8a38234795/users/c60ee318222c4043bc733b8255154ece/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:01.368065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.393751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1063/2142] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.393751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.402616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2259d4f-7f64-4bc9-a521-18c22633caaf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.438516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2235ed-0369-4108-99a9-344e0adf313e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.443550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c91c1-245d-4b03-b318-288d91d1ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.444232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c91c1-245d-4b03-b318-288d91d1ace2 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.444518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c91c1-245d-4b03-b318-288d91d1ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.444795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c91c1-245d-4b03-b318-288d91d1ace2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.445532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c91c1-245d-4b03-b318-288d91d1ace2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.447198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c91c1-245d-4b03-b318-288d91d1ace2 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.457882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:01.459760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1080/2143] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.461384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.461631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.462203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.473327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.474000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.474287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.474583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.475332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.477046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.488007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1064/2144] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.488905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.491622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] MFA Rules not processed for user `c60ee318222c4043bc733b8255154ece`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:01.492923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.498975 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3fc66-174a-4fe4-8757-9350f8a9360e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.503848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.504504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.504793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.505070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.505799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.507419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.520914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1065/2145] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.520914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.522697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:01.529113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbcd04-9be7-4312-a3c4-61d960c005dc admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.534696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.535639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.535924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.536201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] PATH_INFO: `/v3/projects/d179daa4c6314d2c98a790743d309f5c/users/0976327ab67542afae1d719b9af2eb1e/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.552446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d179daa4c6314d2c98a790743d309f5c, user_id=0976327ab67542afae1d719b9af2eb1e, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.555164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.571186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1066/2146] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:01 2022] PUT /identity/v3/projects/d179daa4c6314d2c98a790743d309f5c/users/0976327ab67542afae1d719b9af2eb1e/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:01.571839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1081/2147] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:01.572212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.572629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.586081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad070c-3246-4615-800b-9dfa42502d6a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.641490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38239-f659-4d8e-a7a5-9d091c4fa7a2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.643097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c43bda-e3ea-4d68-a5e9-09543f386d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.644022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43bda-e3ea-4d68-a5e9-09543f386d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.644305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43bda-e3ea-4d68-a5e9-09543f386d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.644584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43bda-e3ea-4d68-a5e9-09543f386d41 admin admin] PATH_INFO: `/v3/projects/ad1b6eb00a42458da083b38202669f10/users/90a88fd9677a4ac7bb905e1605098737/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.646327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.647214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.647530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.647813 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] PATH_INFO: `/v3/projects/fad799b28fc2495ebcc95ee0045bb784/users/48530aebbf344ff398ed612347b18f76/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.665926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43bda-e3ea-4d68-a5e9-09543f386d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1b6eb00a42458da083b38202669f10, user_id=90a88fd9677a4ac7bb905e1605098737, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.666263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad799b28fc2495ebcc95ee0045bb784, user_id=48530aebbf344ff398ed612347b18f76, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.668692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43bda-e3ea-4d68-a5e9-09543f386d41 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.669014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.684510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1082/2148] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:01 2022] PUT /identity/v3/projects/ad1b6eb00a42458da083b38202669f10/users/90a88fd9677a4ac7bb905e1605098737/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:01.685020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1067/2149] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:01 2022] PUT /identity/v3/projects/fad799b28fc2495ebcc95ee0045bb784/users/48530aebbf344ff398ed612347b18f76/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:01.685978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.687990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.690020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.690406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.690778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.708167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:01.709358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.750574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197d79a-b04e-4880-a312-3a27d4d9efc5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.755107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.755859 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.756249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.756535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.772047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1083/2150] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:01.776097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.785917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1582ce8b-1432-4935-a064-0bc6ba760da1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.790588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2957d8-7b6f-4605-a845-b1b255d9a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.791245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2957d8-7b6f-4605-a845-b1b255d9a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.791577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2957d8-7b6f-4605-a845-b1b255d9a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.791851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2957d8-7b6f-4605-a845-b1b255d9a3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.792580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2957d8-7b6f-4605-a845-b1b255d9a3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.794219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2957d8-7b6f-4605-a845-b1b255d9a3d4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.808283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1084/2151] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:01.812160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.812261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:01.812352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.812609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.829222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.830709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.831672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:01.832883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.843304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1068/2152] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:01.843512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1085/2153] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:01.843512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.844468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.846505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.861970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc1108-d54c-4770-8e36-2a4f0941aec5 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:01.867265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:01.868293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:01.868496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:01.868779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] PATH_INFO: `/v3/projects/fad799b28fc2495ebcc95ee0045bb784/users/48530aebbf344ff398ed612347b18f76/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:01.872230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad799b28fc2495ebcc95ee0045bb784, user_id=48530aebbf344ff398ed612347b18f76, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:01.881355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:01.883706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:01.907368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1069/2154] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:01 2022] PUT /identity/v3/projects/fad799b28fc2495ebcc95ee0045bb784/users/48530aebbf344ff398ed612347b18f76/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:01.907368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:01.907368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:01.935483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5502e9-7c85-4fde-b7b7-46d6327d048c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:02.010380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a72e1f-3d2e-4543-8e74-8aef97a27bf2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:02.015678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76caf6-cd63-4a5b-961f-0161e68f68e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:02.016768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76caf6-cd63-4a5b-961f-0161e68f68e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:02.017346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76caf6-cd63-4a5b-961f-0161e68f68e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:02.018116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76caf6-cd63-4a5b-961f-0161e68f68e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:02.034412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:02.035522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:02.035881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:02.036168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:02.118965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76caf6-cd63-4a5b-961f-0161e68f68e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:02.120527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76caf6-cd63-4a5b-961f-0161e68f68e2 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:02.137483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1070/2155] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:02.138821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:02.139228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:02.139538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:02.145778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:02.149588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:02.167351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1086/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:02.182192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] MFA Rules not processed for user `48530aebbf344ff398ed612347b18f76`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:02.185114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:02.313871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1071/2157] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:02.340839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:02.417708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900f2e3-9c4d-4506-80cf-4a6e89fcb90d service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:02.422256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099cdfc-0a72-449a-b3b9-ea8d1307c2d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:02.422905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099cdfc-0a72-449a-b3b9-ea8d1307c2d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:02.424549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099cdfc-0a72-449a-b3b9-ea8d1307c2d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:02.424901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099cdfc-0a72-449a-b3b9-ea8d1307c2d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:02.507143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:02.528616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099cdfc-0a72-449a-b3b9-ea8d1307c2d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:02.530138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099cdfc-0a72-449a-b3b9-ea8d1307c2d2 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:02.556277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1087/2158] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:02.659979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:02.662306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:02.685754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:02.691458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275786ea-432e-4c11-84d2-059d5138fcea None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:02.697017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:02.697773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:02.698116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:02.698398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:02.701286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:02.904771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:02.906276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2351-28a0-46cd-8773-d036d477dc27 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:02.930527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1072/2159] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:03.186067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:03.186616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:03.186698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:03.229953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] MFA Rules not processed for user `90a88fd9677a4ac7bb905e1605098737`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:03.231172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:03.316542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:03.316850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:03.317115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:03.331820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1088/2160] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:03.348614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:03.365570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a374e-52f3-4d42-9859-592f1ec52cf0 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:03.374766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:03.375779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:03.376238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:03.377309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:03.379167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] MFA Rules not processed for user `0976327ab67542afae1d719b9af2eb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:03.381132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:03.388164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:03.390566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:03.404283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1089/2161] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:03.468776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1073/2162] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:03.515637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:03.527591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8dcaf-bcef-412d-a130-e04d0a4bb87d service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:03.534210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb492fd0-61d8-4bd4-86d2-3e2148c7a192 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:03.535005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492fd0-61d8-4bd4-86d2-3e2148c7a192 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:03.535380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492fd0-61d8-4bd4-86d2-3e2148c7a192 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:03.535687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb492fd0-61d8-4bd4-86d2-3e2148c7a192 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:03.557478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492fd0-61d8-4bd4-86d2-3e2148c7a192 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:03.560143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb492fd0-61d8-4bd4-86d2-3e2148c7a192 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:03.574522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1090/2163] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:04.140335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:04.151370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0affc1-ba0b-416a-a2f9-51c3d62dec6a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:04.155094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f0f025-a2d6-4d36-b158-d99d9140fced service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:04.155789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0f025-a2d6-4d36-b158-d99d9140fced service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:04.156104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0f025-a2d6-4d36-b158-d99d9140fced service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:04.156376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f0f025-a2d6-4d36-b158-d99d9140fced service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:04.166204 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0f025-a2d6-4d36-b158-d99d9140fced service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:04.167724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f0f025-a2d6-4d36-b158-d99d9140fced service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:04.178563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1074/2164] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:04.959017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:04.959989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:04.960641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:04.984376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] MFA Rules not processed for user `90a88fd9677a4ac7bb905e1605098737`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:04.986460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:04.993836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1091/2165] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:05.071149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:05.071149 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:05.071346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:05.096542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] MFA Rules not processed for user `0976327ab67542afae1d719b9af2eb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:05.096787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:05.113030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1075/2166] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:07.953078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:07.954666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:07.980487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaff9d5-3fce-4dc2-b3c8-cd6f7129e271 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:07.996059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:07.997375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:07.997831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:07.998268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] PATH_INFO: `/v3/users/0d6f85dc30f54c2eb9f6c78a1c93fe5f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:08.000815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6f85dc30f54c2eb9f6c78a1c93fe5f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:08.002882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:08.089510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6f85dc30f54c2eb9f6c78a1c93fe5f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.110208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6f85dc30f54c2eb9f6c78a1c93fe5f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.119980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6f85dc30f54c2eb9f6c78a1c93fe5f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.120980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6f85dc30f54c2eb9f6c78a1c93fe5f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.121764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6f85dc30f54c2eb9f6c78a1c93fe5f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.139473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1092/2167] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:07 2022] DELETE /identity/v3/users/0d6f85dc30f54c2eb9f6c78a1c93fe5f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:08.314171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:08.330689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d9539-56c8-4543-84e4-ecf12223dd3e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:08.429085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:08.430133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:08.430420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:08.430815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] PATH_INFO: `/v3/users/06cfcad8408a413da42b1e780e659938` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:08.432267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06cfcad8408a413da42b1e780e659938)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:08.435355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:08.454023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:08.526809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06cfcad8408a413da42b1e780e659938'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.527529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06cfcad8408a413da42b1e780e659938'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.544104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06cfcad8408a413da42b1e780e659938'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.546056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06cfcad8408a413da42b1e780e659938'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.578424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5c080ac5-dacc-474a-a2e5-add4efe25a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06cfcad8408a413da42b1e780e659938'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.604422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:08.605839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:08.610542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1076/2168] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:08 2022] DELETE /identity/v3/users/06cfcad8408a413da42b1e780e659938 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:08.612469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:08.612767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:08.613174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:08.640839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:08.646770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:08.655071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:08.728909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04753840-463a-4698-b0a3-47d0f3f714c5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:08.792934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:08.794224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:08.794715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:08.795554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:08.797831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:08.816522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1077/2169] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:08.817792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:08.819393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:08.833502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474b849-6b79-4ebb-a405-2f1d75ad05ad None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:08.841935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:08.843366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:08.843845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:08.844449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] PATH_INFO: `/v3/projects/897f95d4ba0b470f844c37f07d6bfee2` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:08.846639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=897f95d4ba0b470f844c37f07d6bfee2)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:08.848997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:08.903285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:08.905034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:08.921746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1093/2170] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:08.925401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:08.928083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:08.938594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897f95d4ba0b470f844c37f07d6bfee2', 'request_id': 'req-fa8b85df-0d58-4740-b422-c24c7d9b80ad'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.944836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897f95d4ba0b470f844c37f07d6bfee2', 'request_id': 'req-fa8b85df-0d58-4740-b422-c24c7d9b80ad'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.951652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897f95d4ba0b470f844c37f07d6bfee2', 'request_id': 'req-fa8b85df-0d58-4740-b422-c24c7d9b80ad'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.970822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] The token cache is being invalidate because project 897f95d4ba0b470f844c37f07d6bfee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:08.971129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.971985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-fa8b85df-0d58-4740-b422-c24c7d9b80ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:08.977090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1078/2171] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:08 2022] DELETE /identity/v3/projects/897f95d4ba0b470f844c37f07d6bfee2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:08.978613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49d0d-70bd-4641-bd48-3db2f6817570 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:08.978912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49d0d-70bd-4641-bd48-3db2f6817570 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:08.979254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a49d0d-70bd-4641-bd48-3db2f6817570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.004841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-22a49d0d-70bd-4641-bd48-3db2f6817570 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:09.006144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-22a49d0d-70bd-4641-bd48-3db2f6817570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:09.013986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fedf3-ad8e-4ed0-8c69-e501ab631cc3 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.017478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:09.085699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1079/2172] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:09.093212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:09.094214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.094527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.094828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.106038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.107033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.107689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.108387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.111461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:09.127584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:09.129543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:09.132041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.134318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.141815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1080/2173] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:09.147128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.148099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1094/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:09.161640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f661e9f2-e84c-437c-a1ef-9b914a153383 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.167914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.168803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.169215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.169520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.170345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:09.170714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.173452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.191678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1081/2175] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:09.196459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.211007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b765cc7-2b08-4e9b-9e18-dc55d91a07bc service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.216536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.217937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.218444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.218843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.220481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.224703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.272437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1095/2176] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:09 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:09.276681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.293609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c65da-f88c-43d2-8457-301064a8660f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.393787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.394572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.394862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.395195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.396043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.398298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.421867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1082/2177] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:09 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:09.426211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.437247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555014e-8558-4e59-859b-2af662abaa29 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.443521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be073e-e249-45db-ba59-28839218207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.444204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be073e-e249-45db-ba59-28839218207f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.444488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be073e-e249-45db-ba59-28839218207f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.444766 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be073e-e249-45db-ba59-28839218207f admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.445523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be073e-e249-45db-ba59-28839218207f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.447137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be073e-e249-45db-ba59-28839218207f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.459856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1096/2178] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:09.464293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.475716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29847b76-89c7-4961-99ba-adf567a728c4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.481188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44a9a1-6f70-44a1-b7c4-93d7c0d71183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.481900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a9a1-6f70-44a1-b7c4-93d7c0d71183 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.482181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a9a1-6f70-44a1-b7c4-93d7c0d71183 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.482458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44a9a1-6f70-44a1-b7c4-93d7c0d71183 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.483226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a9a1-6f70-44a1-b7c4-93d7c0d71183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.484874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44a9a1-6f70-44a1-b7c4-93d7c0d71183 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.503257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1083/2179] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:09.508998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be073e-e249-45db-ba59-28839218207f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.525980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be073e-e249-45db-ba59-28839218207f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.531668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.533763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.534027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.534772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] PATH_INFO: `/v3/projects/083ac36029824fcbad27fa8e51e26286/users/aaf5f62cbda949e88276b256b70fb459/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.553679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083ac36029824fcbad27fa8e51e26286, user_id=aaf5f62cbda949e88276b256b70fb459, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.557013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.575631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1097/2180] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:09 2022] PUT /identity/v3/projects/083ac36029824fcbad27fa8e51e26286/users/aaf5f62cbda949e88276b256b70fb459/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:09.581452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.581826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.582201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.612928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:09.615196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:09.747094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1084/2181] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:09.794894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.796698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:09.894464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:09.897528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:09.897993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f117153-77ca-442b-a257-c3931460b3d3 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.908587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.909219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.909505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.909783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.919194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21f704-1ec2-4396-87ca-0abdd58106c6 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:09.932665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.934783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.951711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:09.954665 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:09.955123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1098/2182] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:09.959892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:09.960186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] PATH_INFO: `/v3/projects/cbd06e32bc5f4d29bd5abe76c4936f57` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:09.965260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbd06e32bc5f4d29bd5abe76c4936f57)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:09.969141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:09.987473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:10.055690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbd06e32bc5f4d29bd5abe76c4936f57', 'request_id': 'req-ffe457ca-401e-443b-ab56-c4830cbe1f27'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.078545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbd06e32bc5f4d29bd5abe76c4936f57', 'request_id': 'req-ffe457ca-401e-443b-ab56-c4830cbe1f27'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.087877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbd06e32bc5f4d29bd5abe76c4936f57', 'request_id': 'req-ffe457ca-401e-443b-ab56-c4830cbe1f27'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.115451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] The token cache is being invalidate because project cbd06e32bc5f4d29bd5abe76c4936f57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:10.115451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.115451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.115451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1085/2183] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:09 2022] DELETE /identity/v3/projects/cbd06e32bc5f4d29bd5abe76c4936f57 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:10.116061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:10.128524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b153fd-9e37-4730-83b0-395a815b5b1a service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:10.241776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:10.242669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:10.243097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:10.243412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] PATH_INFO: `/v3/users/48530aebbf344ff398ed612347b18f76` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:10.245077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48530aebbf344ff398ed612347b18f76)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:10.247038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:10.300193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:10.319759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48530aebbf344ff398ed612347b18f76'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.338047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48530aebbf344ff398ed612347b18f76'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.351517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48530aebbf344ff398ed612347b18f76'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.353232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48530aebbf344ff398ed612347b18f76'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.354248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-31deca7f-1be8-4778-a163-8af039f63ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48530aebbf344ff398ed612347b18f76'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:10.378059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1099/2184] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:10 2022] DELETE /identity/v3/users/48530aebbf344ff398ed612347b18f76 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:10.977237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:10.978945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:10.994788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe457ca-401e-443b-ab56-c4830cbe1f27 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.056781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.057604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.057887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.058164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] PATH_INFO: `/v3/projects/fad799b28fc2495ebcc95ee0045bb784` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.059423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad799b28fc2495ebcc95ee0045bb784)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.061330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.134814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad799b28fc2495ebcc95ee0045bb784', 'request_id': 'req-276ef723-b8c5-40d6-b5f3-d8062c049f25'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.150919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad799b28fc2495ebcc95ee0045bb784', 'request_id': 'req-276ef723-b8c5-40d6-b5f3-d8062c049f25'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.164480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad799b28fc2495ebcc95ee0045bb784', 'request_id': 'req-276ef723-b8c5-40d6-b5f3-d8062c049f25'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.185590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] The token cache is being invalidate because project fad799b28fc2495ebcc95ee0045bb784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:11.185905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.186736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-276ef723-b8c5-40d6-b5f3-d8062c049f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.189169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1086/2185] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:10 2022] DELETE /identity/v3/projects/fad799b28fc2495ebcc95ee0045bb784 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:11.194099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.194874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.195161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.221304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:11.222724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:11.342702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1100/2186] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:11.344128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.344590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.344954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.369291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:11.371242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:11.385915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1087/2187] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:11.386125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.401284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e89a1d-0a0c-4c8c-b6f1-9d3fdbe84323 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.413944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.414900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.415556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.415996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.417317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:11.417813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.419804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.435446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1101/2188] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:11.440023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.455361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb41c6-214b-4921-ab4d-a2a037622231 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.463371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.466093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.466625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.467393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.468658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.470699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.495363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:11.506196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1088/2189] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:11 2022] POST /identity/v3/projects => generated 381 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:11.511390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.524663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5cd6e-70cc-40da-a8a2-1ae9001be38e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.668198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.669172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.669319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.669821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.670713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.673491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.699305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1102/2190] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:11 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:11.703112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.721066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c58cf-e923-4538-8991-f04de19daebe admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.736578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.737532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.738073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.738557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.739575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.741401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.766330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1089/2191] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:11.767797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.777297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.780325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:11.780458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe3009-584f-4a9f-9173-e0e70b8c85c9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.786658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.786658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.786867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.787048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.787839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.789956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.806488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1103/2192] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:11.811361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:11.819566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b1bfe8-92c8-4b1f-9879-fa3d713c62ca admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.822088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695e59d-e9d8-45ec-a28d-4934325110d2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:11.824825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760edb9-4ab8-4ff1-96e1-74e2e77955f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.825795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760edb9-4ab8-4ff1-96e1-74e2e77955f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.826400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760edb9-4ab8-4ff1-96e1-74e2e77955f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.826690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760edb9-4ab8-4ff1-96e1-74e2e77955f7 admin admin] PATH_INFO: `/v3/projects/9aa6e59f0ea945dab0ab0c7730aece15/users/afda42d539004f3681844d9467ce81c0/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.828460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:11.829769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.830579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.832234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] PATH_INFO: `/v3/users/e59a84e92f5a481fa1f41949de5ab0bc` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.833745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59a84e92f5a481fa1f41949de5ab0bc)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.836197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.840887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:11.845478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760edb9-4ab8-4ff1-96e1-74e2e77955f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa6e59f0ea945dab0ab0c7730aece15, user_id=afda42d539004f3681844d9467ce81c0, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:11.848920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760edb9-4ab8-4ff1-96e1-74e2e77955f7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:11.882626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1104/2193] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:11 2022] PUT /identity/v3/projects/9aa6e59f0ea945dab0ab0c7730aece15/users/afda42d539004f3681844d9467ce81c0/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:11.894846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:11.895122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:11.895678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:11.915653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59a84e92f5a481fa1f41949de5ab0bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.916410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59a84e92f5a481fa1f41949de5ab0bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.930031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59a84e92f5a481fa1f41949de5ab0bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.930983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59a84e92f5a481fa1f41949de5ab0bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:11.933365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] MFA Rules not processed for user `afda42d539004f3681844d9467ce81c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:11.934604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:11.954670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-f53eaad6-4e0c-4c92-b701-8fcd63d5ed90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59a84e92f5a481fa1f41949de5ab0bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:12.000041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1090/2194] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:11 2022] DELETE /identity/v3/users/e59a84e92f5a481fa1f41949de5ab0bc => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:12.004467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.004870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.005250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.025962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:12.027476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.035971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1105/2195] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:12.040954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.042349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.107010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1091/2196] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:12.125406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.126983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.160970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ee072-370b-4ef1-b8e7-90260f569d4c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.170978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.170978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.170978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.170978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.171752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.171752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.211526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1106/2197] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:12 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:12.215381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.244437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972e3c7-9662-49e3-936e-657855c6d618 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.261278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:12.311259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6dbba-faea-45ec-b273-10fb545bc80b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.319903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.320668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.321198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.321693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.322397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.324545 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.327439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.328139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.328431 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.328707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.336906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:12.341400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.343050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.354544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1107/2198] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:12 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:12.355281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1092/2199] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:12.355542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.365727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857cbcb-ae3a-43cd-9253-8110eb42e8c1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.370434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.371104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.371420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.371710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.372474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.374105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.385578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1108/2200] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:12.389638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.402550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7fbc74-996d-4b50-b4a0-11f6036d68df service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.408435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.409463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.410035 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.410193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] PATH_INFO: `/v3/projects/542e7d1a71da41ac9b9e61378ad1f55f/users/eba70985c49743a0bb19da4123baa29a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.429994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=542e7d1a71da41ac9b9e61378ad1f55f, user_id=eba70985c49743a0bb19da4123baa29a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.433459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.449583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1093/2201] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:12 2022] PUT /identity/v3/projects/542e7d1a71da41ac9b9e61378ad1f55f/users/eba70985c49743a0bb19da4123baa29a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:12.453671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.467057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d858a-95c8-4350-ab8f-7a4271e443d5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.538749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5d585-97f1-42e7-9472-7cdbd7a5e81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.539622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5d585-97f1-42e7-9472-7cdbd7a5e81f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.539905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5d585-97f1-42e7-9472-7cdbd7a5e81f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.540186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5d585-97f1-42e7-9472-7cdbd7a5e81f admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.541102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5d585-97f1-42e7-9472-7cdbd7a5e81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.546561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5d585-97f1-42e7-9472-7cdbd7a5e81f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.560704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1109/2202] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:12.565439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.576562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85036ca-3e35-4b49-bd8f-6f3c50922c1c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.583729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.584634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.585118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.585406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] PATH_INFO: `/v3/projects/542e7d1a71da41ac9b9e61378ad1f55f/users/eba70985c49743a0bb19da4123baa29a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.587497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] RBAC: Authorizing `identity:create_grant(project_id=542e7d1a71da41ac9b9e61378ad1f55f, user_id=eba70985c49743a0bb19da4123baa29a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.590466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.601770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1094/2203] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:12 2022] PUT /identity/v3/projects/542e7d1a71da41ac9b9e61378ad1f55f/users/eba70985c49743a0bb19da4123baa29a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:12.612005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.612300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.612581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.642420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] MFA Rules not processed for user `eba70985c49743a0bb19da4123baa29a`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:12.643273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.705469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.707213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.798400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1110/2204] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:12.816297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe332c-c338-45d1-be43-2a57f8e0769a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.821207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.821382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.822297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.822648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.823025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.823479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] PATH_INFO: `/v3/projects/f02531ef241549669d346cf66f95d86c` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.824958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02531ef241549669d346cf66f95d86c)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:12.827045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:12.895948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02531ef241549669d346cf66f95d86c', 'request_id': 'req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:12.904513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02531ef241549669d346cf66f95d86c', 'request_id': 'req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:12.914769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02531ef241549669d346cf66f95d86c', 'request_id': 'req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:12.925392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaf8965-5ace-4e23-a57c-c2ea17b2f878 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:12.941120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] The token cache is being invalidate because project f02531ef241549669d346cf66f95d86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:12.941672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:12.942592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:12.944375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1095/2205] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:12 2022] DELETE /identity/v3/projects/f02531ef241549669d346cf66f95d86c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:12.949048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:12.951111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:12.955231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:12.972777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:12.991336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:12.992013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:12.992296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:12.992572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:12.994387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:13.054976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c35ee6-f86c-401b-9c7d-e2b5c72be9d6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:13.060978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:13.062026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:13.062413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:13.062793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] PATH_INFO: `/v3/users/dc3f3154faa94e2d9e59f27b2f603732` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:13.064754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3f3154faa94e2d9e59f27b2f603732)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:13.066844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:13.084478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:13.085970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:13.099025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1111/2206] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:13.129271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3f3154faa94e2d9e59f27b2f603732'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:13.130409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3f3154faa94e2d9e59f27b2f603732'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:13.142473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3f3154faa94e2d9e59f27b2f603732'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:13.159930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3f3154faa94e2d9e59f27b2f603732'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:13.181190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3f3154faa94e2d9e59f27b2f603732'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:13.211469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1096/2207] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:12 2022] DELETE /identity/v3/users/dc3f3154faa94e2d9e59f27b2f603732 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:13.619832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:13.632392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c242bb6-f49b-4fb3-b8f8-8edcdb3e6c37 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:13.697508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:13.698943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:13.725756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eba70985c49743a0bb19da4123baa29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542e7d1a71da41ac9b9e61378ad1f55f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:13.726463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:13.726760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:13.727376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:13.727826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:13.728150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:13.730520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:13.748956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1112/2208] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:13.749906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:13.751964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:13.765534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249b993-2ce1-4add-9539-7824d278c9ce tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:13.771426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eba70985c49743a0bb19da4123baa29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542e7d1a71da41ac9b9e61378ad1f55f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:13.772318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:13.772646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:13.773192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:13.773886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:13.775837 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:13.800928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c06b68-4076-4afd-94b5-c4cc688dcfa2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:13.819900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1113/2209] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:13 2022] POST /identity/v3/projects => generated 355 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:13.820616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:13.889549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:13.904500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:13.913557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f7bc8-2e2c-41d8-87a9-8f99acace3c4 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:13.922019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eba70985c49743a0bb19da4123baa29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542e7d1a71da41ac9b9e61378ad1f55f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:13.922910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:13.923367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:13.924415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:13.925788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:13.926402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:13.930499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:13.939579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:13.941163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:13.941456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:13.941737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] PATH_INFO: `/v3/projects/cea046e537c145b48764e899ac5891ae` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:13.943025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea046e537c145b48764e899ac5891ae)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:13.945085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:13.958411 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1114/2210] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:14.026407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:14.040601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe02a6-4628-4421-a4e8-55a8af0de6f3 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:14.059302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea046e537c145b48764e899ac5891ae', 'request_id': 'req-e70effe3-105a-422e-bb47-6586e50bfad1'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.065999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea046e537c145b48764e899ac5891ae', 'request_id': 'req-e70effe3-105a-422e-bb47-6586e50bfad1'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.084290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea046e537c145b48764e899ac5891ae', 'request_id': 'req-e70effe3-105a-422e-bb47-6586e50bfad1'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.101750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] The token cache is being invalidate because project cea046e537c145b48764e899ac5891ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:14.102028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.106360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.108075 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1097/2211] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:13 2022] DELETE /identity/v3/projects/cea046e537c145b48764e899ac5891ae => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:14.112739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:14.114942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:14.137969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eba70985c49743a0bb19da4123baa29a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '542e7d1a71da41ac9b9e61378ad1f55f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:14.139002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:14.139399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:14.139861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] PATH_INFO: `/v3/projects/7e596eda7ec34022badaeccd8ddfc8e4` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:14.142753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e596eda7ec34022badaeccd8ddfc8e4)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:14.145210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:14.198887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70effe3-105a-422e-bb47-6586e50bfad1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:14.214496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e596eda7ec34022badaeccd8ddfc8e4', 'request_id': 'req-5135be89-492b-40ca-8ed5-adc294eca2d9'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.222733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e596eda7ec34022badaeccd8ddfc8e4', 'request_id': 'req-5135be89-492b-40ca-8ed5-adc294eca2d9'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.247352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e596eda7ec34022badaeccd8ddfc8e4', 'request_id': 'req-5135be89-492b-40ca-8ed5-adc294eca2d9'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.264517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] The token cache is being invalidate because project 7e596eda7ec34022badaeccd8ddfc8e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:14.264813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.265559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.267196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1115/2212] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:14 2022] DELETE /identity/v3/projects/7e596eda7ec34022badaeccd8ddfc8e4 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:14.299465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:14.302449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:14.302739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:14.303384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] PATH_INFO: `/v3/users/c60ee318222c4043bc733b8255154ece` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:14.305915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60ee318222c4043bc733b8255154ece)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:14.309945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:14.367510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:14.423079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60ee318222c4043bc733b8255154ece'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.427629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60ee318222c4043bc733b8255154ece'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.450934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60ee318222c4043bc733b8255154ece'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.451934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60ee318222c4043bc733b8255154ece'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.485032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-449d322c-4574-43a3-82f8-2f0df6939ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60ee318222c4043bc733b8255154ece'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.507954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1098/2213] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:14 2022] DELETE /identity/v3/users/c60ee318222c4043bc733b8255154ece => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:14.592405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:14.594518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:14.637826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135be89-492b-40ca-8ed5-adc294eca2d9 tempest-VolumeQuotaClassesTest-815572467 tempest-VolumeQuotaClassesTest-815572467-project-admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:14.760331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:14.762439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:14.762834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:14.763342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] PATH_INFO: `/v3/users/afda42d539004f3681844d9467ce81c0` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:14.764959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=afda42d539004f3681844d9467ce81c0)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:14.773118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:14.797329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:14.875712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afda42d539004f3681844d9467ce81c0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.895166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afda42d539004f3681844d9467ce81c0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.906117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afda42d539004f3681844d9467ce81c0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.907081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afda42d539004f3681844d9467ce81c0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.908200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afda42d539004f3681844d9467ce81c0'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:14.935215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1116/2214] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:14 2022] DELETE /identity/v3/users/afda42d539004f3681844d9467ce81c0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:14.940118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:14.940521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:14.941003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:14.960992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:14.962373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:15.100515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1099/2215] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:15.111666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:15.112947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:15.129563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:15.132337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1a0d5-47d4-4861-8f8a-0e063237f7fa admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:15.132787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:15.138391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:15.139290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.139619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.139895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] PATH_INFO: `/v3/projects/b84bb496683c48f1ae821d8a38234795` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.141164 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84bb496683c48f1ae821d8a38234795)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:15.143148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:15.208341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84bb496683c48f1ae821d8a38234795', 'request_id': 'req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:15.217820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84bb496683c48f1ae821d8a38234795', 'request_id': 'req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:15.225272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2172a2-06f0-4eae-b960-043657f069a5 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:15.232198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84bb496683c48f1ae821d8a38234795', 'request_id': 'req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:15.249122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] The token cache is being invalidate because project b84bb496683c48f1ae821d8a38234795 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:15.249952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:15.250280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8ee2ad6-4338-4423-a1eb-5a7a2bcfbd6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:15.254116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1117/2216] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:15 2022] DELETE /identity/v3/projects/b84bb496683c48f1ae821d8a38234795 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:15.259828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551cdb-2158-4807-acd8-18c611925010 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.260260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551cdb-2158-4807-acd8-18c611925010 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.260646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97551cdb-2158-4807-acd8-18c611925010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.288379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-97551cdb-2158-4807-acd8-18c611925010 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:15.290181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-97551cdb-2158-4807-acd8-18c611925010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:15.301543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:15.302212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.302496 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.303176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.305880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:15.316061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:15.415234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1118/2217] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:15.424018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.424310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.424597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.424716 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:15.426494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:15.442586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1100/2218] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:15.467584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:15.469643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:15.486811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1119/2219] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:15.487167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:15.501827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef08d0-1da0-4143-8373-53494cf5d5d6 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:15.510796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:15.511888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.512414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.514726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.515682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:15.516123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:15.522709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:15.547591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1101/2220] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:15.553403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:15.565278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:15.573891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d349a1-2ada-4945-91dd-f2b8dec57d99 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:15.590429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:15.591485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.591883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.592515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.593295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:15.596254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:15.645841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1120/2221] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:15 2022] POST /identity/v3/projects => generated 409 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:15.650879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:15.676957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c4261-be69-4587-83bb-2cdb3d29fdda admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:15.866948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:15.867678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.875659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.876024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.876779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:15.881258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:15.916376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1102/2222] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:15 2022] POST /identity/v3/users => generated 305 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:15.919510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:15.937008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047944a-2ceb-4b27-a33c-4b134506dac9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:15.952512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:15.953674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:15.954602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:15.955910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:15.958399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:15.976492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.010205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.011463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1121/2223] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:48:16.032862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.034525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc33f9-0cea-452a-83d1-f7c0e5720dda admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.039711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.067848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.068688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.070794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.071647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.073276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.083701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.097441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf71670-d46a-4cdc-b334-2de399c0af9f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.109782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.113623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1103/2224] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:16.114086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.114086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.114086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] PATH_INFO: `/v3/projects/9aa6e59f0ea945dab0ab0c7730aece15` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.114086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa6e59f0ea945dab0ab0c7730aece15)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.114751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.115873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.144259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053b1cc-bcf7-469d-bc7e-2139eca48579 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.160578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51472db4-791d-441e-83b5-edfaf7164c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.161494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51472db4-791d-441e-83b5-edfaf7164c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.161775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51472db4-791d-441e-83b5-edfaf7164c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.163966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51472db4-791d-441e-83b5-edfaf7164c3e admin admin] PATH_INFO: `/v3/projects/cdf30117e1c340679d36b5f9aedb668b/users/1afcffa9a5fa4b15913032b17cd1c697/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.225543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51472db4-791d-441e-83b5-edfaf7164c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf30117e1c340679d36b5f9aedb668b, user_id=1afcffa9a5fa4b15913032b17cd1c697, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.227485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51472db4-791d-441e-83b5-edfaf7164c3e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.240124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa6e59f0ea945dab0ab0c7730aece15', 'request_id': 'req-c1598705-c181-473f-a729-b8deb47bdefa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.245963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1104/2225] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:16 2022] PUT /identity/v3/projects/cdf30117e1c340679d36b5f9aedb668b/users/1afcffa9a5fa4b15913032b17cd1c697/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:16.249920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa6e59f0ea945dab0ab0c7730aece15', 'request_id': 'req-c1598705-c181-473f-a729-b8deb47bdefa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.259397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.259853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.260231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.265446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa6e59f0ea945dab0ab0c7730aece15', 'request_id': 'req-c1598705-c181-473f-a729-b8deb47bdefa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.287587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] The token cache is being invalidate because project 9aa6e59f0ea945dab0ab0c7730aece15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:16.288168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.289004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.290844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1122/2226] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:16 2022] DELETE /identity/v3/projects/9aa6e59f0ea945dab0ab0c7730aece15 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:16.292687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] MFA Rules not processed for user `1afcffa9a5fa4b15913032b17cd1c697`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:16.294607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.295529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.297165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.343711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:16.412997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1105/2227] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:16.414540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.416295 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.417223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1598705-c181-473f-a729-b8deb47bdefa admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.520271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.521339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.521770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.522374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] PATH_INFO: `/v3/users/eba70985c49743a0bb19da4123baa29a` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.524613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba70985c49743a0bb19da4123baa29a)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.527987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.533805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:16.541421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055c92f-3c47-4a7f-9d77-3eaf6e206217 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.554587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.555313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.555643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.555945 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.556659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.558639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.616744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba70985c49743a0bb19da4123baa29a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.631612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1106/2228] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:16 2022] POST /identity/v3/projects => generated 407 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:16.632717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.636450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba70985c49743a0bb19da4123baa29a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.646218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba70985c49743a0bb19da4123baa29a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.647305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba70985c49743a0bb19da4123baa29a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.647631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-cb5f58dd-fcf9-46b5-b209-2b775c5740aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba70985c49743a0bb19da4123baa29a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:16.666269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1123/2229] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:16 2022] DELETE /identity/v3/users/eba70985c49743a0bb19da4123baa29a => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:16.668160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0b6d-bf00-4dcb-b6d0-3ea81295c9cb None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.668497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0b6d-bf00-4dcb-b6d0-3ea81295c9cb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.668775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f0b6d-bf00-4dcb-b6d0-3ea81295c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.710916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-173f0b6d-bf00-4dcb-b6d0-3ea81295c9cb None None] MFA Rules not processed for user `aaf5f62cbda949e88276b256b70fb459`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:16.712194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-173f0b6d-bf00-4dcb-b6d0-3ea81295c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.722220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1d1a2-6a0b-40e8-98bf-8d8cd4d1a909 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.823196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.823965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.824254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.824919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.825240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.827213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.834855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1124/2230] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:16.849605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:16.856149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.856451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.856737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.872487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1107/2231] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:16 2022] POST /identity/v3/users => generated 310 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:16.873741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.877069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.887954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] MFA Rules not processed for user `aaf5f62cbda949e88276b256b70fb459`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:16.889323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.900530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1125/2232] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:16.912752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.914205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:16.916987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861e3ae-d92c-4d96-adf6-72a88d5501cc admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.923993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.925004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.925608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.926036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.927180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.929220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:16.944423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1108/2233] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:16.945576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:16.958766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c81b0-af7f-4613-a490-bb7062139b59 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:16.964103 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:16.965357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:16.965715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:16.966004 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] PATH_INFO: `/v3/projects/6bc38219ba68477d8f6da072c2be94e8/users/6244ea471c6d4285bb94f010c549af88/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:16.983207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc38219ba68477d8f6da072c2be94e8, user_id=6244ea471c6d4285bb94f010c549af88, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:16.986208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.002338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:17.010917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1109/2234] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:16 2022] PUT /identity/v3/projects/6bc38219ba68477d8f6da072c2be94e8/users/6244ea471c6d4285bb94f010c549af88/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:17.014959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:17.016123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23280e-5758-4925-b4eb-51265a3e8474 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.109465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbd3ce-6d54-469a-b5ee-f287d1902994 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.116493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:17.117276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.117636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.118138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.118952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:17.123881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.145089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1110/2235] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:48:17.146061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:17.149588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:17.152277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:17.154289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.155294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.157590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.172556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e227f-a453-465c-8aee-5637d323584a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.179596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:17.181150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.181552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.181901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] PATH_INFO: `/v3/projects/542e7d1a71da41ac9b9e61378ad1f55f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.183363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542e7d1a71da41ac9b9e61378ad1f55f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:17.185502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.250731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:17.260502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.297160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1126/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:17.299949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:17.300286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542e7d1a71da41ac9b9e61378ad1f55f', 'request_id': 'req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:17.322625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542e7d1a71da41ac9b9e61378ad1f55f', 'request_id': 'req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:17.328410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b8697-4558-4056-b0a5-f4f011ab73bb service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.333997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542e7d1a71da41ac9b9e61378ad1f55f', 'request_id': 'req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:17.382378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] The token cache is being invalidate because project 542e7d1a71da41ac9b9e61378ad1f55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:17.382378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:17.384972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d7b4e5ce-96c1-4dce-ac0a-22a8d707d518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:17.391259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1111/2237] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:17 2022] DELETE /identity/v3/projects/542e7d1a71da41ac9b9e61378ad1f55f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:17.397078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c3c15-25d1-4b37-9266-d0dab678d252 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.397398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c3c15-25d1-4b37-9266-d0dab678d252 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.398532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c3c15-25d1-4b37-9266-d0dab678d252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.463535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-990c3c15-25d1-4b37-9266-d0dab678d252 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:17.465032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-990c3c15-25d1-4b37-9266-d0dab678d252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:17.517613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f021431-036d-4d57-bfea-d1cd3d7f85db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:17.518777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021431-036d-4d57-bfea-d1cd3d7f85db admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.519263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021431-036d-4d57-bfea-d1cd3d7f85db admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.519691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f021431-036d-4d57-bfea-d1cd3d7f85db admin admin] PATH_INFO: `/v3/projects/6bc38219ba68477d8f6da072c2be94e8/users/6244ea471c6d4285bb94f010c549af88/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.522592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021431-036d-4d57-bfea-d1cd3d7f85db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc38219ba68477d8f6da072c2be94e8, user_id=6244ea471c6d4285bb94f010c549af88, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:17.526226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f021431-036d-4d57-bfea-d1cd3d7f85db admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.550151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1127/2238] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:17 2022] PUT /identity/v3/projects/6bc38219ba68477d8f6da072c2be94e8/users/6244ea471c6d4285bb94f010c549af88/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:17.550946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:17.561092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.561748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.562222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.605783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1112/2239] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:17.614493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.614963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.615397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.617125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] MFA Rules not processed for user `6244ea471c6d4285bb94f010c549af88`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:17.618682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:17.649659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:17.651150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:17.658203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:17.744728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1128/2240] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:17.758113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:17.759893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:17.819642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1113/2241] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:17.822615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:17.847049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc9e49-955a-44b5-8fa6-f8f7ab0dd5f7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.859715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:17.860441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.860728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.861002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.861750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:17.862054 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:17.887613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.919846 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1114/2242] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:17.923913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:17.941226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476aba3a-73db-4802-a174-e58fc5ba6f82 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.957436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:17.957577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebfe510-37f8-420c-8979-dd4c7a6ee31f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:17.958116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:17.958401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:17.958709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:17.984382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:17.986574 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:17.997383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.000181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.000181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.006357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.007095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.010979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.030141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1129/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:17 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:18.074255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1115/2244] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:17 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:18.078244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.106464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbd77-665e-4f14-b5fb-8e0931f3cd50 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:18.246490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.249985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.250280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.250566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.252286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.256696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.297327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1130/2245] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:18 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:18.303094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.330098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e0468-f4e5-4da3-a5fe-d894d43ecbfb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:18.331682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.337675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.339353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.339353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.340696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.341845 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.346434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.364583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1116/2246] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:18.368005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.408177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d991c-0017-4b37-bd5c-613452c15258 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:18.427889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.428739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.429060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.429347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.437285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.439195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.443872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b79cb45-5035-4def-9a9e-c91ccc55b874 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:18.460548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.461290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.461580 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.464429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.467458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:18.475849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:18.479537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1117/2247] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:48:18.483779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.506598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498ab28-5e7a-45bd-a6aa-65e8e9c622c7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:18.519160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.520760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.521217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.521509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] PATH_INFO: `/v3/projects/7774e7c63e53424f8fc4b1205458ca8b/users/886e7cdb47824924a743b741ea08a7a8/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.540609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7774e7c63e53424f8fc4b1205458ca8b, user_id=886e7cdb47824924a743b741ea08a7a8, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.543759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.563139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.565532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcad315-7908-4b68-aa5f-fbe2fe1ae643 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.578064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1131/2248] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:18 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:18.584721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1118/2249] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:18 2022] PUT /identity/v3/projects/7774e7c63e53424f8fc4b1205458ca8b/users/886e7cdb47824924a743b741ea08a7a8/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:18.596633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bd686-fcec-466b-8090-39589dd71fae None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.601748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bd686-fcec-466b-8090-39589dd71fae None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.602714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bd686-fcec-466b-8090-39589dd71fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.670188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f08bd686-fcec-466b-8090-39589dd71fae None None] MFA Rules not processed for user `886e7cdb47824924a743b741ea08a7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:18.672628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f08bd686-fcec-466b-8090-39589dd71fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:18.789906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1132/2250] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:18.794124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.906519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821cd8c-e617-41a9-a468-f1d159ca4720 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:18.912792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:18.913668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.914045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.914415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.915767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:18.930795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:18.930795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:18.940134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:18.940903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:18.941236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:18.968913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1119/2251] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:18 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:18.970798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:18.989325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] MFA Rules not processed for user `aaf5f62cbda949e88276b256b70fb459`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:18.990578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:19.111844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8565c9ae-18ee-4cc3-b23b-a46bb7e61f75 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.139458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.144890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.145653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.145946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.148281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:19.156299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:19.210541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1120/2252] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:18 2022] POST /identity/v3/users => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:19.213682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:19.238670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dbb693-694a-4af1-8449-c9e7a78e41bb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.241631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1133/2253] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:19.250209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.251223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.251629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.252126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.260990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:19.270713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:19.313418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1121/2254] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:19.314199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:19.333415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef7a31-b353-4afc-ab11-c29a68ab2f6e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.343209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.352320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.353163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.353804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] PATH_INFO: `/v3/projects/923e4d7325cd4ff5b265934d0e17ffe3/users/fc232ef6a87946a7b647f2e1e459fd54/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.397071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=923e4d7325cd4ff5b265934d0e17ffe3, user_id=fc232ef6a87946a7b647f2e1e459fd54, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:19.404624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:19.440026 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1134/2255] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:19 2022] PUT /identity/v3/projects/923e4d7325cd4ff5b265934d0e17ffe3/users/fc232ef6a87946a7b647f2e1e459fd54/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:19.441708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:19.457762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de073506-3964-4dd8-8fa3-faa69426b475 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.542794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce92f5-0cf6-49aa-bb49-1c3b71bbba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.544128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce92f5-0cf6-49aa-bb49-1c3b71bbba14 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.544462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce92f5-0cf6-49aa-bb49-1c3b71bbba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.544737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce92f5-0cf6-49aa-bb49-1c3b71bbba14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.545795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce92f5-0cf6-49aa-bb49-1c3b71bbba14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:19.547760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce92f5-0cf6-49aa-bb49-1c3b71bbba14 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:19.559682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1122/2256] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:19.563915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:19.574241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571a592-3a0f-4991-a47e-e7f87c820e1c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.579422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.580353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.580641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.580918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] PATH_INFO: `/v3/projects/923e4d7325cd4ff5b265934d0e17ffe3/users/fc232ef6a87946a7b647f2e1e459fd54/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.583027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923e4d7325cd4ff5b265934d0e17ffe3, user_id=fc232ef6a87946a7b647f2e1e459fd54, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:19.585797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:19.597898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1135/2257] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:19 2022] PUT /identity/v3/projects/923e4d7325cd4ff5b265934d0e17ffe3/users/fc232ef6a87946a7b647f2e1e459fd54/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:19.609430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.609731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.610071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.640471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] MFA Rules not processed for user `fc232ef6a87946a7b647f2e1e459fd54`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:19.643970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:19.702805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:19.728844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1123/2258] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:19.739918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:19.742165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:19.748253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:19.816107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8b4ef-2dc4-4614-82e1-33ca1a306672 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.823311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.824058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.824350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.829712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:19.842725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:19.845173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:19.869867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1136/2259] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:19.919569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:19.934576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e79c0f-c671-4595-9fc1-4063f2ddbac1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:19.941574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf4611-9e25-4b1f-8c3b-c754193bb908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:19.942924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4611-9e25-4b1f-8c3b-c754193bb908 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:19.943384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4611-9e25-4b1f-8c3b-c754193bb908 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:19.943758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf4611-9e25-4b1f-8c3b-c754193bb908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:20.095250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf4611-9e25-4b1f-8c3b-c754193bb908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:20.097858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edf4611-9e25-4b1f-8c3b-c754193bb908 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:20.116327 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1124/2260] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:24.765939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:24.830952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837eb7a-a591-4865-9c1a-4e8d0b0bf8cf service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:24.835367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:24.836245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:24.836530 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:24.836807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] PATH_INFO: `/v3/users/886e7cdb47824924a743b741ea08a7a8` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:24.837988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886e7cdb47824924a743b741ea08a7a8)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:24.840228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:24.888009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886e7cdb47824924a743b741ea08a7a8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:24.902648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886e7cdb47824924a743b741ea08a7a8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:24.912362 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886e7cdb47824924a743b741ea08a7a8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:24.913102 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886e7cdb47824924a743b741ea08a7a8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:24.913918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886e7cdb47824924a743b741ea08a7a8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:24.935516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1137/2261] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:24 2022] DELETE /identity/v3/users/886e7cdb47824924a743b741ea08a7a8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:24.940704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:24.941157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:24.941255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:24.962328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:24.964002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:25.043491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1125/2262] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:25.054227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:25.056345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:25.100599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:25.157502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40efc597-b47c-47cf-b49a-d79fa8238659 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:25.165494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c2744-cb09-4fe2-b55a-9fdfbcc6a23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:25.166419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2744-cb09-4fe2-b55a-9fdfbcc6a23f service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:25.166923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2744-cb09-4fe2-b55a-9fdfbcc6a23f service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:25.167393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c2744-cb09-4fe2-b55a-9fdfbcc6a23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:25.181655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2744-cb09-4fe2-b55a-9fdfbcc6a23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:25.183426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c2744-cb09-4fe2-b55a-9fdfbcc6a23f service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:25.196222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1138/2263] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:25.690899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:25.693001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:25.717773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91018d-c647-4c14-82dc-f92118e356ff None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:25.727006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:25.728352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:25.728886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:25.729545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] PATH_INFO: `/v3/users/1afcffa9a5fa4b15913032b17cd1c697` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:25.732165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1afcffa9a5fa4b15913032b17cd1c697)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:25.734637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:25.854758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1afcffa9a5fa4b15913032b17cd1c697'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:25.855466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1afcffa9a5fa4b15913032b17cd1c697'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:25.864480 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1afcffa9a5fa4b15913032b17cd1c697'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:25.865318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1afcffa9a5fa4b15913032b17cd1c697'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:25.889816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1afcffa9a5fa4b15913032b17cd1c697'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:25.896265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:25.916623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1126/2264] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:25 2022] DELETE /identity/v3/users/1afcffa9a5fa4b15913032b17cd1c697 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:25.921115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:25.921654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:25.921654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:25.972850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:25.974112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:26.067026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:26.069453 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:26.125282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1139/2265] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:26.135526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:26.135897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:26.174481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84c4af-78c9-4e5e-9ba5-75ad88ab5ebf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:26.180910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:26.181800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:26.182080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:26.182359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] PATH_INFO: `/v3/projects/7774e7c63e53424f8fc4b1205458ca8b` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:26.184687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7774e7c63e53424f8fc4b1205458ca8b)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:26.186927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:26.218781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b98d8-690c-4fbc-8995-ea8ca03c0368 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:26.224005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:26.224750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:26.225027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:26.225364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:26.245557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:26.246823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:26.257229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1140/2266] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:26.260691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7774e7c63e53424f8fc4b1205458ca8b', 'request_id': 'req-dc656144-7254-4bce-b7fc-f9652253a29a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.272509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7774e7c63e53424f8fc4b1205458ca8b', 'request_id': 'req-dc656144-7254-4bce-b7fc-f9652253a29a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.281118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7774e7c63e53424f8fc4b1205458ca8b', 'request_id': 'req-dc656144-7254-4bce-b7fc-f9652253a29a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.310289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] The token cache is being invalidate because project 7774e7c63e53424f8fc4b1205458ca8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:26.310879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.312930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.319149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:26.319279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1127/2267] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:26 2022] DELETE /identity/v3/projects/7774e7c63e53424f8fc4b1205458ca8b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:26.331728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3afd5-72d1-49af-9103-4073a0045003 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:26.442955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:26.444483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:26.444833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:26.445139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] PATH_INFO: `/v3/users/fc232ef6a87946a7b647f2e1e459fd54` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:26.446586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc232ef6a87946a7b647f2e1e459fd54)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:26.449264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:26.485487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:26.558301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc232ef6a87946a7b647f2e1e459fd54'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.580521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc232ef6a87946a7b647f2e1e459fd54'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.596196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc232ef6a87946a7b647f2e1e459fd54'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.596496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc232ef6a87946a7b647f2e1e459fd54'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.599441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc232ef6a87946a7b647f2e1e459fd54'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:26.623163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1141/2268] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:26 2022] DELETE /identity/v3/users/fc232ef6a87946a7b647f2e1e459fd54 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:26.862242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:26.863772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:26.876821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc656144-7254-4bce-b7fc-f9652253a29a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:26.947056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:26.947958 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:26.950907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:26.951217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] PATH_INFO: `/v3/projects/cdf30117e1c340679d36b5f9aedb668b` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:26.952028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:26.952541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf30117e1c340679d36b5f9aedb668b)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:26.953437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:26.955009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:26.967931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e40d38-71e3-4983-9ff7-390c5c6967e7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:26.973440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:26.975047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:26.975685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:26.975987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] PATH_INFO: `/v3/projects/923e4d7325cd4ff5b265934d0e17ffe3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:26.977364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923e4d7325cd4ff5b265934d0e17ffe3)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:26.979295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:26.992722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:27.017271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf30117e1c340679d36b5f9aedb668b', 'request_id': 'req-8c399415-5254-462c-8cee-540fa11727ca'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.023293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf30117e1c340679d36b5f9aedb668b', 'request_id': 'req-8c399415-5254-462c-8cee-540fa11727ca'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.029946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf30117e1c340679d36b5f9aedb668b', 'request_id': 'req-8c399415-5254-462c-8cee-540fa11727ca'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.035344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923e4d7325cd4ff5b265934d0e17ffe3', 'request_id': 'req-f8f591e9-fbb3-447b-8cf2-1116a8404c37'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.041786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] The token cache is being invalidate because project cdf30117e1c340679d36b5f9aedb668b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:27.041936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923e4d7325cd4ff5b265934d0e17ffe3', 'request_id': 'req-f8f591e9-fbb3-447b-8cf2-1116a8404c37'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.042115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.042698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.044282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1128/2269] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:26 2022] DELETE /identity/v3/projects/cdf30117e1c340679d36b5f9aedb668b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:27.049016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.050535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.050868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923e4d7325cd4ff5b265934d0e17ffe3', 'request_id': 'req-f8f591e9-fbb3-447b-8cf2-1116a8404c37'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.061229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] The token cache is being invalidate because project 923e4d7325cd4ff5b265934d0e17ffe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:27.061609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.062160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f8f591e9-fbb3-447b-8cf2-1116a8404c37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.065514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1142/2270] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:26 2022] DELETE /identity/v3/projects/923e4d7325cd4ff5b265934d0e17ffe3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:27.072932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed485d28-3875-4710-a268-2a7d56adf9be None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.073218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed485d28-3875-4710-a268-2a7d56adf9be None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.073496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed485d28-3875-4710-a268-2a7d56adf9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.092537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ed485d28-3875-4710-a268-2a7d56adf9be None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:27.093735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ed485d28-3875-4710-a268-2a7d56adf9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.125572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c399415-5254-462c-8cee-540fa11727ca admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.161719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1143/2271] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:27.169173 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.169882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.170167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.187905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:27.188809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.189205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.189687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.189980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.190260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] PATH_INFO: `/v3/users/6244ea471c6d4285bb94f010c549af88` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.191492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6244ea471c6d4285bb94f010c549af88)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.193412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.205155 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1144/2272] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:27.209111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.218526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e267f-c983-4320-8541-9ad04d8dc8ac None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.225319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.226095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.226544 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.226946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.227786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:27.228346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.230216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.232001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:27.243830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6244ea471c6d4285bb94f010c549af88'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.244495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6244ea471c6d4285bb94f010c549af88'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.248833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1145/2273] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:48:27.249872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.253884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.258949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6244ea471c6d4285bb94f010c549af88'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.259762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6244ea471c6d4285bb94f010c549af88'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.268513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9934806-16bc-498a-9605-a18c0e34cc3a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.268838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:27.274126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.274783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.275068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.276073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.276208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.276299 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6244ea471c6d4285bb94f010c549af88'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.278105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.291961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1129/2274] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:27 2022] DELETE /identity/v3/users/6244ea471c6d4285bb94f010c549af88 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:27.315390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1146/2275] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:27.317925 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.388123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b174797-d4d2-4279-a6ae-e55159d2320b admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.459389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.460200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.460492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.460775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.461483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.463568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.486719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1130/2276] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:27.488251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.502884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be68144-feea-44a6-8d5f-49b96ab24440 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.507651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.508325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.508617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.508897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.509650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.512421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.528028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1147/2277] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:27.529018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.539697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d3a5-e9c9-47c1-9e6a-90f5b73df2c7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.544822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.545711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.546099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.546381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.547772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.549590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.566541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1131/2278] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:27.571143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.580697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.582224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99b0eb-408e-4b33-a445-c234ef9ce110 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.582410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.587566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04a424-d746-48c4-ab06-b449601aac54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.593484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a424-d746-48c4-ab06-b449601aac54 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.593780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a424-d746-48c4-ab06-b449601aac54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.594063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04a424-d746-48c4-ab06-b449601aac54 admin admin] PATH_INFO: `/v3/projects/518c1175f0694744b1a28f60721b9315/users/2090d37a50704c8eb7b48ece03be5b56/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.596468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787d7ec-151b-4bfa-8add-36546f0d2358 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.602087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.602968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.603255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.603568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] PATH_INFO: `/v3/projects/6bc38219ba68477d8f6da072c2be94e8` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.604942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc38219ba68477d8f6da072c2be94e8)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.606824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.612512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04a424-d746-48c4-ab06-b449601aac54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518c1175f0694744b1a28f60721b9315, user_id=2090d37a50704c8eb7b48ece03be5b56, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.618399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04a424-d746-48c4-ab06-b449601aac54 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.639657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1148/2279] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:27 2022] PUT /identity/v3/projects/518c1175f0694744b1a28f60721b9315/users/2090d37a50704c8eb7b48ece03be5b56/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:27.648914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925000-d9d3-4411-b8d4-5afe9d20059f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.649210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925000-d9d3-4411-b8d4-5afe9d20059f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.649492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925000-d9d3-4411-b8d4-5afe9d20059f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.684217 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8b925000-d9d3-4411-b8d4-5afe9d20059f None None] MFA Rules not processed for user `2090d37a50704c8eb7b48ece03be5b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:27.685571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8b925000-d9d3-4411-b8d4-5afe9d20059f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.688543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc38219ba68477d8f6da072c2be94e8', 'request_id': 'req-b5dfa220-9711-423a-818b-5bcc378956ea'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.694143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc38219ba68477d8f6da072c2be94e8', 'request_id': 'req-b5dfa220-9711-423a-818b-5bcc378956ea'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.702469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc38219ba68477d8f6da072c2be94e8', 'request_id': 'req-b5dfa220-9711-423a-818b-5bcc378956ea'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.705055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:27.722013 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] The token cache is being invalidate because project 6bc38219ba68477d8f6da072c2be94e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:27.722348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.723144 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.726206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1132/2280] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:27 2022] DELETE /identity/v3/projects/6bc38219ba68477d8f6da072c2be94e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:27.726206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.728650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.772318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1149/2281] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:27.773931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.774414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.774930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.802043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:27.802043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.820159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfa220-9711-423a-818b-5bcc378956ea admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.828301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.829604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.829886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.830518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] PATH_INFO: `/v3/users/8196df6e7c8e406f81d38e08b181cd16` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.832183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8196df6e7c8e406f81d38e08b181cd16)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.834455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.865390 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1150/2282] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:27.866386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.867712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.880255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b82a74-69b5-434e-9ac7-40d2b36862da None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:27.886516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7dcc1-ff34-4262-a1a2-d0d9ebb719c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:27.887204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7dcc1-ff34-4262-a1a2-d0d9ebb719c8 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.887499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7dcc1-ff34-4262-a1a2-d0d9ebb719c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.887796 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7dcc1-ff34-4262-a1a2-d0d9ebb719c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.888478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7dcc1-ff34-4262-a1a2-d0d9ebb719c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:27.890748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7dcc1-ff34-4262-a1a2-d0d9ebb719c8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:27.918999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8196df6e7c8e406f81d38e08b181cd16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.919791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8196df6e7c8e406f81d38e08b181cd16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.925820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1151/2283] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:27.927275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ed78-bfdc-43dc-9d92-9c7b6d57edcc None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:27.927756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ed78-bfdc-43dc-9d92-9c7b6d57edcc None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:27.928147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1ed78-bfdc-43dc-9d92-9c7b6d57edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:27.932297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8196df6e7c8e406f81d38e08b181cd16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.933259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8196df6e7c8e406f81d38e08b181cd16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.936294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:27.948526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-30f1ed78-bfdc-43dc-9d92-9c7b6d57edcc None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:27.949099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8196df6e7c8e406f81d38e08b181cd16'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:27.949683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-30f1ed78-bfdc-43dc-9d92-9c7b6d57edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:27.964426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1133/2284] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:27 2022] DELETE /identity/v3/users/8196df6e7c8e406f81d38e08b181cd16 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:27.968533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:27.969932 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.024915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1152/2285] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:28.026220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.026507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.026783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.045010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:28.046305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.055401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee93ca-3843-4d5c-940b-3561d884efcd admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.056590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1153/2286] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:28.057429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.065175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.065878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.066420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.066611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.067313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.068602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca14fa-b853-4392-a0ec-9373e6f910c5 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.069260 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.073266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.073918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.074208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.074489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.075212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:28.075555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.077153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.086099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=5,keystone:DELETE=11,keystone:SELECT=84 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:28.090846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1154/2287] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:28.091520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1134/2288] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:27 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:28.095314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.095456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.097064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.107612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0b013-42fa-44b7-a0df-6c7bc87a12a4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.114263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.115034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.115334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.115609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.116341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.117931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.129066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1135/2289] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:48:28.130121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.142124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c564f5-61e3-4758-b879-8ad745b2818f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.146468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.147111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.147436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.147711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.148397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.150275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.166203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a28d4c-4a62-4545-96df-c9979b9d6b0d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.171110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.172030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.172793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.172793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.180544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1136/2290] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:28.184027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.184897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.185503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.196518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1155/2291] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:28.197401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.207276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc887e28-7c5a-45a9-9e91-5768f58d4164 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.257129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc78a9-cf9e-4378-b538-b16768a81ef7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.264482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.265163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.265538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.265824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.267405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.269305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.278450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.279088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.279468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.279801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.280500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.282263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1137/2292] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:28.282538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.286645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.300114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027deed-722a-46e1-9158-04d2a499aa6f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.309466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b6944-c00d-4789-8a70-08146608b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.310538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1156/2293] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:28.311591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6944-c00d-4789-8a70-08146608b41d admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.311955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6944-c00d-4789-8a70-08146608b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.312318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b6944-c00d-4789-8a70-08146608b41d admin admin] PATH_INFO: `/v3/projects/0832674d03734edda31492a6f7ce0af5/users/b643f74f17ca4a928f1086dfb64e22bc/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.316319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.329371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec2608a-908d-4073-a902-97515284ddc5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.335218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.335486 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b6944-c00d-4789-8a70-08146608b41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0832674d03734edda31492a6f7ce0af5, user_id=b643f74f17ca4a928f1086dfb64e22bc, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.336033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.336316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.336703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.337448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.339980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.340226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b6944-c00d-4789-8a70-08146608b41d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.351862 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1157/2294] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:28.355804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.372321 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65a201-6431-40dc-b6e5-a100a3e76dfc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.372618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1138/2295] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:28 2022] PUT /identity/v3/projects/0832674d03734edda31492a6f7ce0af5/users/b643f74f17ca4a928f1086dfb64e22bc/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:28.374012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.374312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.374595 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.389047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:28.409708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] MFA Rules not processed for user `b643f74f17ca4a928f1086dfb64e22bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:28.411600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.463087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.463790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.464125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.464406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.465796 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.467911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.478943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1158/2296] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:28.482936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.497355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55bca3-f332-488f-8895-1eaa7a21b0f4 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.503133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1139/2297] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:48:28.504479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.504613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.506274 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.506575 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.506888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] PATH_INFO: `/v3/projects/e33604430e524222bedc3a86c1d03863/users/85dc437321cc402888ac23ff05ec291b/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.518549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d743f-425e-446e-8fd0-caec8a236d05 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.524242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde23940-ccce-4e86-9eb8-7ce3060bbdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.524654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23940-ccce-4e86-9eb8-7ce3060bbdfc admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.525463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23940-ccce-4e86-9eb8-7ce3060bbdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.525463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde23940-ccce-4e86-9eb8-7ce3060bbdfc admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.526205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23940-ccce-4e86-9eb8-7ce3060bbdfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.526457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33604430e524222bedc3a86c1d03863, user_id=85dc437321cc402888ac23ff05ec291b, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.528219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde23940-ccce-4e86-9eb8-7ce3060bbdfc admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.529922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.547163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1159/2298] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:28 2022] PUT /identity/v3/projects/e33604430e524222bedc3a86c1d03863/users/85dc437321cc402888ac23ff05ec291b/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:28.562812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.565426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.569186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1140/2299] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:48:28.570568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.570862 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.571145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.584328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:28.599261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] MFA Rules not processed for user `85dc437321cc402888ac23ff05ec291b`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:28.600561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.639034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755073ad-588f-4c11-a6dc-a8686f2eae4f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.671943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1141/2300] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:28.675902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.698232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.699511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.699782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.700316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] PATH_INFO: `/v3/projects/3dde028411c0494586fbaa3f1563010d` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.701510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dde028411c0494586fbaa3f1563010d)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.704346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.749690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:28.754978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f261f-73a8-4fd5-9a88-6bbb4e083d1e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.768652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dde028411c0494586fbaa3f1563010d', 'request_id': 'req-4534b3bb-af9d-49d7-ad04-04c5f79094c8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:28.774946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dde028411c0494586fbaa3f1563010d', 'request_id': 'req-4534b3bb-af9d-49d7-ad04-04c5f79094c8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:28.787387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dde028411c0494586fbaa3f1563010d', 'request_id': 'req-4534b3bb-af9d-49d7-ad04-04c5f79094c8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:28.793950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] The token cache is being invalidate because project 3dde028411c0494586fbaa3f1563010d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:28.794235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:28.794890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:28.796475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1160/2301] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:28 2022] DELETE /identity/v3/projects/3dde028411c0494586fbaa3f1563010d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:28.800427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.801790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.832823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622dac6-f397-4745-a26a-3a5c49d1701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.833507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622dac6-f397-4745-a26a-3a5c49d1701d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.833792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622dac6-f397-4745-a26a-3a5c49d1701d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.834073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622dac6-f397-4745-a26a-3a5c49d1701d admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.834773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622dac6-f397-4745-a26a-3a5c49d1701d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.837446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622dac6-f397-4745-a26a-3a5c49d1701d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.863535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1142/2302] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/users => generated 298 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:28.865318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.865318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.865318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.889767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:28.892607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.898613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534b3bb-af9d-49d7-ad04-04c5f79094c8 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.901398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1143/2303] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:28.903996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeca0b1-7413-4268-90d3-ae8d0c8fbce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.904664 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca0b1-7413-4268-90d3-ae8d0c8fbce0 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.904950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca0b1-7413-4268-90d3-ae8d0c8fbce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.905228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca0b1-7413-4268-90d3-ae8d0c8fbce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.905918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeca0b1-7413-4268-90d3-ae8d0c8fbce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.908223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeca0b1-7413-4268-90d3-ae8d0c8fbce0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.908365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.909620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.921281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34066e03-d9c1-4e6c-8c9a-55dfb6fb5cd7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.926280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:28.926959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.927237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.927567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.928288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:28.930353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:28.939366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1161/2304] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:28.939684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:28.939978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:28.940285 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:28.944136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1144/2305] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:28.945165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:28.963948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dbe5aa-b9cb-408a-874c-aef0d940cc2e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:28.964427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:28.965903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:28.976907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:29.028883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.029653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.030302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.030425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.031253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.034073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.043126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1162/2306] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:29.044669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.055843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e4ede-c1d7-46d6-b099-64702fada09a None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.060659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1145/2307] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:28 2022] POST /identity/v3/users => generated 297 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:29.060659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.064239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.065259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.065622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.066311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] PATH_INFO: `/v3/projects/240f96454b24457e9c14461c42857cf3/users/cd8bdc1116f744f9b83de40ccf57392a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.070146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e986e4a3-41b3-4c70-ba9d-922e4a96fcbd admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.074920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.075740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.076105 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.076446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.077263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:29.077630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.079920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.085293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] RBAC: Authorizing `identity:create_grant(project_id=240f96454b24457e9c14461c42857cf3, user_id=cd8bdc1116f744f9b83de40ccf57392a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.088016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.096815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1146/2308] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:29.096815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.106098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adda420-02ae-4bea-8f35-7c9e16f80e9d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.112250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.112959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.113246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.113525 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.114290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.114552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1163/2309] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:29 2022] PUT /identity/v3/projects/240f96454b24457e9c14461c42857cf3/users/cd8bdc1116f744f9b83de40ccf57392a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:29.117522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.117647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.128735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1147/2310] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:29.129593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.140588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436c0c4-e290-4bd7-a91c-709b8945c54a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.143543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:29.209417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f12cb-9615-4c14-b92a-ad0018da367b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.214144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.215082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.215308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.215458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.215660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.215999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.216280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.216381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.216551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.217275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.218324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.218873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.228732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1148/2311] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:29.232494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.243518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631a8b6-ab40-429b-8f01-c88167e41c51 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.244813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1164/2312] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:29 2022] POST /identity/v3/projects => generated 391 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:29.245594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.304828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605d7f9-829c-4fe4-bdd2-0b025d34238e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.305892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d7f9-829c-4fe4-bdd2-0b025d34238e admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.306404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d7f9-829c-4fe4-bdd2-0b025d34238e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.306759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605d7f9-829c-4fe4-bdd2-0b025d34238e admin admin] PATH_INFO: `/v3/projects/28af7870aa724609898ac80744d0d377/users/cf2ee197fd824c128f817397c70fff2b/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.311157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04b9c0-f8bd-43f9-abb7-da0b349ca7c3 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.316947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.317863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.318145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.318427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] PATH_INFO: `/v3/projects/240f96454b24457e9c14461c42857cf3/users/cd8bdc1116f744f9b83de40ccf57392a/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.320559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=240f96454b24457e9c14461c42857cf3, user_id=cd8bdc1116f744f9b83de40ccf57392a, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.321837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d7f9-829c-4fe4-bdd2-0b025d34238e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28af7870aa724609898ac80744d0d377, user_id=cf2ee197fd824c128f817397c70fff2b, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.323254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.324577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605d7f9-829c-4fe4-bdd2-0b025d34238e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.335028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1165/2313] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:29 2022] PUT /identity/v3/projects/240f96454b24457e9c14461c42857cf3/users/cd8bdc1116f744f9b83de40ccf57392a/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:29.336053 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.344890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:29.344890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1149/2314] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:29 2022] PUT /identity/v3/projects/28af7870aa724609898ac80744d0d377/users/cf2ee197fd824c128f817397c70fff2b/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:29.348066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.348616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.349083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.379387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] MFA Rules not processed for user `cd8bdc1116f744f9b83de40ccf57392a`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:29.381179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:29.420210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0c333-1963-4732-a216-95f87fb5adbb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.456778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1150/2315] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:29.457816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.469045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:29.487986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.488741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.489097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.489443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.490197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.492212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.517748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1166/2316] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:29 2022] POST /identity/v3/users => generated 296 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:29.517748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.517748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:29.534227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae745b5c-b4dd-4e91-adc8-54dddcf571fb None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.539347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.540041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.540328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.540601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.541336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.542988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.555826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1151/2317] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:29.556658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.566921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694bdb4-77b6-4521-9fd3-fccfce574a71 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.571637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.572354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.572637 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.572919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.573639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.575224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.584128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1400d-3f04-4bd5-a205-84cecee9afd9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.587911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.588565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.588849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.589125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.589740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1152/2318] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:29.590478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.591403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:29.600667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50c312-e3a1-4055-bbce-1be52be3cf8d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.605345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.606325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.606734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.607101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] PATH_INFO: `/v3/projects/28af7870aa724609898ac80744d0d377/users/cf2ee197fd824c128f817397c70fff2b/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.609174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=28af7870aa724609898ac80744d0d377, user_id=cf2ee197fd824c128f817397c70fff2b, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.612395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.623096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1153/2319] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:29 2022] PUT /identity/v3/projects/28af7870aa724609898ac80744d0d377/users/cf2ee197fd824c128f817397c70fff2b/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:29.631799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.655190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.657512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e8b48-90ca-49ed-89da-8b4d6ee8f83b service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.666775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1167/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:29.668087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be12e-062d-4438-9433-fb2819c886be None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.668380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be12e-062d-4438-9433-fb2819c886be None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.668666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8be12e-062d-4438-9433-fb2819c886be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.695433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-db8be12e-062d-4438-9433-fb2819c886be None None] MFA Rules not processed for user `cf2ee197fd824c128f817397c70fff2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:29.697260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-db8be12e-062d-4438-9433-fb2819c886be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:29.698060 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:29.702878 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8dbab-cd0c-4e2b-8e15-5124c338aaed admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.718055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.719021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.720011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.720429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.721310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.723050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.733780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1154/2321] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:29.738646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.748777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aab647-af53-4808-a7e7-2581d9c9e2df admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.754050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a43c9-57b8-4cb9-8dcf-c1ee52f13c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.754929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a43c9-57b8-4cb9-8dcf-c1ee52f13c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.755220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a43c9-57b8-4cb9-8dcf-c1ee52f13c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.755527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a43c9-57b8-4cb9-8dcf-c1ee52f13c9f admin admin] PATH_INFO: `/v3/projects/1e2431737e2e4090b85fa057e0361a7d/users/88c7708899244ca1bfeaa6b8dc748a63/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.773807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a43c9-57b8-4cb9-8dcf-c1ee52f13c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2431737e2e4090b85fa057e0361a7d, user_id=88c7708899244ca1bfeaa6b8dc748a63, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:29.777406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a43c9-57b8-4cb9-8dcf-c1ee52f13c9f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:29.792510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1168/2322] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:29.799764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1155/2323] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:29 2022] PUT /identity/v3/projects/1e2431737e2e4090b85fa057e0361a7d/users/88c7708899244ca1bfeaa6b8dc748a63/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:29.800385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be12e-062d-4438-9433-fb2819c886be None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.808393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-db8be12e-062d-4438-9433-fb2819c886be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:29.811253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.811253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.811457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.831669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:29.841287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] MFA Rules not processed for user `88c7708899244ca1bfeaa6b8dc748a63`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:29.842603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:29.892912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8be12e-062d-4438-9433-fb2819c886be None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.927613 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1156/2324] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:29.954451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.955110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.955676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.956475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:29.966292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:29.991614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471064cd-c50d-46ba-b9ae-44f2f7c3171e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:29.996393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9266eb-0159-4c14-8465-f8469a19fda2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:29.997183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9266eb-0159-4c14-8465-f8469a19fda2 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:29.997542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9266eb-0159-4c14-8465-f8469a19fda2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:29.999370 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9266eb-0159-4c14-8465-f8469a19fda2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:30.018366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9266eb-0159-4c14-8465-f8469a19fda2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:30.021086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9266eb-0159-4c14-8465-f8469a19fda2 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:30.027371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:30.030048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:30.043253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1169/2325] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:30.062973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1157/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:30.597165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:30.662093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd5ad5-18e4-45da-876c-37a0e3ccd0f6 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:30.666565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:30.667496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:30.667781 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:30.668058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] PATH_INFO: `/v3/users/85dc437321cc402888ac23ff05ec291b` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:30.669246 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dc437321cc402888ac23ff05ec291b)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:30.671218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:30.693674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:30.721107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dc437321cc402888ac23ff05ec291b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:30.737258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dc437321cc402888ac23ff05ec291b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:30.746721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dc437321cc402888ac23ff05ec291b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:30.747486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dc437321cc402888ac23ff05ec291b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:30.748090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dc437321cc402888ac23ff05ec291b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:30.764549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1170/2327] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:30 2022] DELETE /identity/v3/users/85dc437321cc402888ac23ff05ec291b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:30.769114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:30.769600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:30.769718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:30.787910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:30.789114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:30.848642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1158/2328] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:30.858175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:30.859615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:30.930039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7cf9b-1257-43f3-921f-a245cc1e24d6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:30.934264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:30.934952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:30.935236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:30.935551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:30.946143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:30.947633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:30.959071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1171/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:31.400024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:31.401415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:31.490962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:31.527222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f342350-7085-45c8-9d8e-a572ce5a11f9 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:31.568630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:31.574763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:31.575693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:31.577249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:31.582473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:31.685365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:31.689592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:31.705124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1159/2330] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:31.915846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:31.917795 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:31.943798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec2f14-7cba-4978-84bd-880323175fee service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:31.948974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:31.949832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:31.950125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:31.950964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] PATH_INFO: `/v3/projects/e33604430e524222bedc3a86c1d03863` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:31.951851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33604430e524222bedc3a86c1d03863)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:31.954358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:32.049123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33604430e524222bedc3a86c1d03863', 'request_id': 'req-22c0b99e-a56e-463f-8346-0aa7e02f8617'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.061134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33604430e524222bedc3a86c1d03863', 'request_id': 'req-22c0b99e-a56e-463f-8346-0aa7e02f8617'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.076309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33604430e524222bedc3a86c1d03863', 'request_id': 'req-22c0b99e-a56e-463f-8346-0aa7e02f8617'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.092713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] The token cache is being invalidate because project e33604430e524222bedc3a86c1d03863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:32.093170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.094436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.096828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1172/2331] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:31 2022] DELETE /identity/v3/projects/e33604430e524222bedc3a86c1d03863 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:32.106812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:32.129476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59116f8-33e8-4c37-bef4-bdb68f5e4357 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:32.193971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:32.194950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:32.195293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:32.195661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] PATH_INFO: `/v3/users/cf2ee197fd824c128f817397c70fff2b` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:32.197012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2ee197fd824c128f817397c70fff2b)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:32.199072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:32.262589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2ee197fd824c128f817397c70fff2b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.263239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2ee197fd824c128f817397c70fff2b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.271006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2ee197fd824c128f817397c70fff2b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.271771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2ee197fd824c128f817397c70fff2b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.285902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2ee197fd824c128f817397c70fff2b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.300519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1160/2332] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:32 2022] DELETE /identity/v3/users/cf2ee197fd824c128f817397c70fff2b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:32.470458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:32.472579 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:32.505761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:32.542264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b99e-a56e-463f-8346-0aa7e02f8617 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:32.596728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:32.598168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:32.603932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:32.604622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:32.604984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:32.605338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:32.607797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:32.635424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:32.677619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:32.678925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a9d63-1cb8-40fd-a66a-68af219580a7 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:32.684957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180fbb62-154c-402b-8855-d7fc3f5efc61 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:32.690807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:32.691792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:32.692137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:32.692474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] PATH_INFO: `/v3/projects/28af7870aa724609898ac80744d0d377` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:32.693033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1173/2333] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:32.693915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28af7870aa724609898ac80744d0d377)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:32.696228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:32.792167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28af7870aa724609898ac80744d0d377', 'request_id': 'req-288598ce-2dcb-4b47-8f95-8a73629a1052'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.800147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28af7870aa724609898ac80744d0d377', 'request_id': 'req-288598ce-2dcb-4b47-8f95-8a73629a1052'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.818410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28af7870aa724609898ac80744d0d377', 'request_id': 'req-288598ce-2dcb-4b47-8f95-8a73629a1052'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.853991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] The token cache is being invalidate because project 28af7870aa724609898ac80744d0d377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:32.854415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.855114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-288598ce-2dcb-4b47-8f95-8a73629a1052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:32.856967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1161/2334] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:32 2022] DELETE /identity/v3/projects/28af7870aa724609898ac80744d0d377 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:32.862062 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:32.862567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:32.862851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:32.881581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:32.882955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:32.947180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1174/2335] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:32.956501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:32.956790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:32.957068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:32.977446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:32.978842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:32.989826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1162/2336] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:32.996673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.007705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe802-c8c7-4417-bd5e-106ea18fc8a6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.012963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.013659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.013950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.014219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.014943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:48:33.015277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.017606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.031365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1175/2337] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:48:33.035997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.055744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22b4d4-212a-4adb-b0c3-a4a3bd85a3bc None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.062777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.064860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.064860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.064860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.065151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.067214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.108663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1163/2338] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:48:33 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:33.112808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.129497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d02f6-0452-4942-969e-40c6342c7342 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.158778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:33.217659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.220388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.220765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.221114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.221909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.224011 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.256071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1176/2339] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:48:33 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:48:33.258562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.277733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a86f-a889-4cc6-808c-01a3447a33a4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.285998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.287471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.287471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.287471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.288380 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.289762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.321472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1164/2340] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:33.326209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.347812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f8a87-6cad-4bf2-9da9-371bd9a05f72 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.354850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1689fb-6abe-454d-885d-dbe4d91a5d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.355888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1689fb-6abe-454d-885d-dbe4d91a5d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.356181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1689fb-6abe-454d-885d-dbe4d91a5d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.356511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1689fb-6abe-454d-885d-dbe4d91a5d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.357252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1689fb-6abe-454d-885d-dbe4d91a5d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.363582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1689fb-6abe-454d-885d-dbe4d91a5d51 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.382118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1177/2341] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:48:33.386301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.398913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28011599-b153-4c3b-9abd-cb983e9da923 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.405291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.406347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.406722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.407081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] PATH_INFO: `/v3/projects/705fb20f88b946a78a7c3658bd3037db/users/24e7704a7cb04bae8450d6c4dd08f807/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.423568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=705fb20f88b946a78a7c3658bd3037db, user_id=24e7704a7cb04bae8450d6c4dd08f807, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.426723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.439806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1165/2342] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:48:33 2022] PUT /identity/v3/projects/705fb20f88b946a78a7c3658bd3037db/users/24e7704a7cb04bae8450d6c4dd08f807/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:48:33.505391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef638-6e94-4dc0-935a-32fd1ad7af6f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.505611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef638-6e94-4dc0-935a-32fd1ad7af6f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.505855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ef638-6e94-4dc0-935a-32fd1ad7af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.532319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-dd4ef638-6e94-4dc0-935a-32fd1ad7af6f None None] MFA Rules not processed for user `24e7704a7cb04bae8450d6c4dd08f807`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:33.533518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-dd4ef638-6e94-4dc0-935a-32fd1ad7af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:33.599655 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1178/2343] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:33.610467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:33.612206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:33.665563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:33.671783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a767cc4f-17c4-4acd-8c6a-1a6d4ae2bc58 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:33.676355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:33.677003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:33.677309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:33.677583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:33.685853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:33.687293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:33.696609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1166/2344] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:36.580443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439ce21-14bd-475b-baf1-69622d6bfd89 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:36.580982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439ce21-14bd-475b-baf1-69622d6bfd89 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:36.580982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439ce21-14bd-475b-baf1-69622d6bfd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:36.598478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1439ce21-14bd-475b-baf1-69622d6bfd89 None None] MFA Rules not processed for user `0976327ab67542afae1d719b9af2eb1e`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:36.599689 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1439ce21-14bd-475b-baf1-69622d6bfd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:36.655591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1179/2345] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:36.727069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:36.728612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:36.795823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b3655-2fb3-451e-873a-7759540bdd79 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:36.801123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:36.802182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:36.802642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:36.802926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] PATH_INFO: `/v3/users/2090d37a50704c8eb7b48ece03be5b56` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:36.804276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2090d37a50704c8eb7b48ece03be5b56)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:36.806249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:36.862640 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2090d37a50704c8eb7b48ece03be5b56'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:36.863309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2090d37a50704c8eb7b48ece03be5b56'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:36.874963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2090d37a50704c8eb7b48ece03be5b56'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:36.876596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2090d37a50704c8eb7b48ece03be5b56'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:36.893150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2090d37a50704c8eb7b48ece03be5b56'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:36.918907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1167/2346] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:36 2022] DELETE /identity/v3/users/2090d37a50704c8eb7b48ece03be5b56 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:36.924680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:36.925339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:36.925956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:36.957054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:36.958446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:37.014389 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:37.064135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1180/2347] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:37.073634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:37.075200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:37.158723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ef9e-3602-40e6-a5e4-98645ac0d02d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:37.162539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:37.163234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:37.163619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:37.163990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:37.174927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:37.176527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:37.186345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1168/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:37.560100 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:37.561717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:37.582520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8321d3f-aacf-4cff-8d7e-a750266fe6ab None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:37.590073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:37.591690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:37.592451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:37.592970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] PATH_INFO: `/v3/projects/518c1175f0694744b1a28f60721b9315` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:37.597704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=518c1175f0694744b1a28f60721b9315)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:37.599720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:37.656514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518c1175f0694744b1a28f60721b9315', 'request_id': 'req-d89337b5-967e-403d-906c-91d3fa71f40a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.674516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518c1175f0694744b1a28f60721b9315', 'request_id': 'req-d89337b5-967e-403d-906c-91d3fa71f40a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.682609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518c1175f0694744b1a28f60721b9315', 'request_id': 'req-d89337b5-967e-403d-906c-91d3fa71f40a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.694955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] The token cache is being invalidate because project 518c1175f0694744b1a28f60721b9315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:37.695231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.695909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.697718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1181/2349] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:37 2022] DELETE /identity/v3/projects/518c1175f0694744b1a28f60721b9315 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:37.701955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:37.712429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1145-7d40-4f7a-9f67-37189d9c0bfd service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:37.723529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:37.804251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:37.806237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:37.806650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:37.807072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] PATH_INFO: `/v3/users/b643f74f17ca4a928f1086dfb64e22bc` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:37.811274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b643f74f17ca4a928f1086dfb64e22bc)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:37.813915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:37.864853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b643f74f17ca4a928f1086dfb64e22bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.865573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b643f74f17ca4a928f1086dfb64e22bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.873695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b643f74f17ca4a928f1086dfb64e22bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.875029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b643f74f17ca4a928f1086dfb64e22bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.888777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b643f74f17ca4a928f1086dfb64e22bc'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:37.903117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1169/2350] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:37 2022] DELETE /identity/v3/users/b643f74f17ca4a928f1086dfb64e22bc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:38.232444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:38.233699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:38.255885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89337b5-967e-403d-906c-91d3fa71f40a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:38.343029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:38.344228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:38.344581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:38.345758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] PATH_INFO: `/v3/projects/0832674d03734edda31492a6f7ce0af5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:38.347000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0832674d03734edda31492a6f7ce0af5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:38.349366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:38.410765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0832674d03734edda31492a6f7ce0af5', 'request_id': 'req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.418382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0832674d03734edda31492a6f7ce0af5', 'request_id': 'req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.421397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:38.429494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0832674d03734edda31492a6f7ce0af5', 'request_id': 'req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.447253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] The token cache is being invalidate because project 0832674d03734edda31492a6f7ce0af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:38.447668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.448357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.452841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1182/2351] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:38 2022] DELETE /identity/v3/projects/0832674d03734edda31492a6f7ce0af5 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:38.454520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:38.456031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:38.478663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e3a6f-ddca-4425-a700-da68a0ad4b97 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:38.559963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:38.561314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:38.561785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:38.562246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] PATH_INFO: `/v3/users/cd8bdc1116f744f9b83de40ccf57392a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:38.564277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8bdc1116f744f9b83de40ccf57392a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:38.566287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:38.611875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:38.624776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8bdc1116f744f9b83de40ccf57392a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.625445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8bdc1116f744f9b83de40ccf57392a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.632220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8bdc1116f744f9b83de40ccf57392a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.632835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8bdc1116f744f9b83de40ccf57392a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.644481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8bdc1116f744f9b83de40ccf57392a'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:38.656308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1170/2352] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:38 2022] DELETE /identity/v3/users/cd8bdc1116f744f9b83de40ccf57392a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:38.935495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:38.936945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:38.951613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54c4ee-3f71-47b3-b2dc-6ffb9506dfb7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:39.034007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:39.034899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:39.035178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:39.035502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] PATH_INFO: `/v3/projects/240f96454b24457e9c14461c42857cf3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:39.036746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=240f96454b24457e9c14461c42857cf3)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:39.038958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:39.103746 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240f96454b24457e9c14461c42857cf3', 'request_id': 'req-9a65b6db-f27a-4272-9f7f-51db926e9892'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:39.111569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240f96454b24457e9c14461c42857cf3', 'request_id': 'req-9a65b6db-f27a-4272-9f7f-51db926e9892'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:39.119759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240f96454b24457e9c14461c42857cf3', 'request_id': 'req-9a65b6db-f27a-4272-9f7f-51db926e9892'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:39.131367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] The token cache is being invalidate because project 240f96454b24457e9c14461c42857cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:39.131658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:39.132427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-9a65b6db-f27a-4272-9f7f-51db926e9892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:39.133934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1183/2353] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:38 2022] DELETE /identity/v3/projects/240f96454b24457e9c14461c42857cf3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:42.889783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:42.891244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:42.903841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e72e69-bbe6-49bf-91a0-1882ac324d42 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:42.958139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:42.959002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:42.959285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:42.959592 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] PATH_INFO: `/v3/users/88c7708899244ca1bfeaa6b8dc748a63` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:42.960764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] RBAC: Authorizing `identity:delete_user(user_id=88c7708899244ca1bfeaa6b8dc748a63)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:42.962689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:43.008452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88c7708899244ca1bfeaa6b8dc748a63'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.009027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88c7708899244ca1bfeaa6b8dc748a63'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.015738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88c7708899244ca1bfeaa6b8dc748a63'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.016355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88c7708899244ca1bfeaa6b8dc748a63'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.027953 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88c7708899244ca1bfeaa6b8dc748a63'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.040307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1171/2354] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:42 2022] DELETE /identity/v3/users/88c7708899244ca1bfeaa6b8dc748a63 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:43.044800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:43.045254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:43.045378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:43.064123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:43.065318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:43.122329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1184/2355] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:43.131614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:43.132997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:43.166688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:43.194245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e21193-4080-4413-a537-ced37776e46d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:43.198084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:43.198740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:43.199026 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:43.199301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:43.208289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:43.209719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:43.220210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1172/2356] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:43.530984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:43.533004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:43.546093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb658d-6397-4022-a966-d17e33178ad5 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:43.552139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:43.553002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:43.553290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:43.553570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] PATH_INFO: `/v3/projects/1e2431737e2e4090b85fa057e0361a7d` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:43.554840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2431737e2e4090b85fa057e0361a7d)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:43.556854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:43.570776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:43.612838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2431737e2e4090b85fa057e0361a7d', 'request_id': 'req-220f8e5b-1262-4aca-bef3-30245e4683e2'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.619842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2431737e2e4090b85fa057e0361a7d', 'request_id': 'req-220f8e5b-1262-4aca-bef3-30245e4683e2'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.628765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2431737e2e4090b85fa057e0361a7d', 'request_id': 'req-220f8e5b-1262-4aca-bef3-30245e4683e2'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.640132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] The token cache is being invalidate because project 1e2431737e2e4090b85fa057e0361a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:43.640427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.641123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-220f8e5b-1262-4aca-bef3-30245e4683e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:43.642763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1185/2357] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:43 2022] DELETE /identity/v3/projects/1e2431737e2e4090b85fa057e0361a7d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:45.968471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:45.970457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:45.983433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277244f-4c35-49e8-a585-d74627b431ae service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:46.038226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:46.038601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:46.038882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:46.039152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] PATH_INFO: `/v3/users/24e7704a7cb04bae8450d6c4dd08f807` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:46.040385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e7704a7cb04bae8450d6c4dd08f807)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:46.042312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:46.086346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e7704a7cb04bae8450d6c4dd08f807'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.086988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e7704a7cb04bae8450d6c4dd08f807'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.094508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e7704a7cb04bae8450d6c4dd08f807'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.095131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e7704a7cb04bae8450d6c4dd08f807'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.106593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e7704a7cb04bae8450d6c4dd08f807'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.119176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1173/2358] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:48:45 2022] DELETE /identity/v3/users/24e7704a7cb04bae8450d6c4dd08f807 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:46.123656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:46.124124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:46.124216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:46.142581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:46.143815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:46.219240 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1186/2359] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:46.228810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:46.230349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:46.289597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cffb6-b3d3-4ff4-b3f1-4ca4d0da9da8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:46.293160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e215e-e70a-4a65-847d-8d97b0c1c1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:46.293810 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e215e-e70a-4a65-847d-8d97b0c1c1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:46.294095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e215e-e70a-4a65-847d-8d97b0c1c1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:46.294375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e215e-e70a-4a65-847d-8d97b0c1c1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:46.300596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:46.305238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e215e-e70a-4a65-847d-8d97b0c1c1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:46.306775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e215e-e70a-4a65-847d-8d97b0c1c1b9 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:46.318471 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1174/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:48:46.595064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:46.596673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:46.613802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779082d8-2421-40b7-ae47-0730072dfae1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:46.620408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:46.621742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:46.622050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:46.622333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] PATH_INFO: `/v3/projects/705fb20f88b946a78a7c3658bd3037db` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:46.623652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=705fb20f88b946a78a7c3658bd3037db)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:46.626379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:46.687368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705fb20f88b946a78a7c3658bd3037db', 'request_id': 'req-915a923d-4cb9-4e26-a3a6-417403d01974'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.694701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705fb20f88b946a78a7c3658bd3037db', 'request_id': 'req-915a923d-4cb9-4e26-a3a6-417403d01974'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.703886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705fb20f88b946a78a7c3658bd3037db', 'request_id': 'req-915a923d-4cb9-4e26-a3a6-417403d01974'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.715988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] The token cache is being invalidate because project 705fb20f88b946a78a7c3658bd3037db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:48:46.716278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.716926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:48:46.718550 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1187/2361] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:48:46 2022] DELETE /identity/v3/projects/705fb20f88b946a78a7c3658bd3037db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:48:50.668678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0f177-821e-499d-8591-66a9fe2e33ae None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:50.669172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0f177-821e-499d-8591-66a9fe2e33ae None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:50.669264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a0f177-821e-499d-8591-66a9fe2e33ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:50.687730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-04a0f177-821e-499d-8591-66a9fe2e33ae None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:50.688962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-04a0f177-821e-499d-8591-66a9fe2e33ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:50.746090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1175/2362] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:50.775213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:50.776640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:50.803755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:48:50.851015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a923d-4cb9-4e26-a3a6-417403d01974 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:50.856480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:50.857126 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:50.857412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:50.857691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:50.866281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:50.867903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:50.877380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1188/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:48:56.818503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776570-3d40-4606-ae51-862b09d43d03 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:56.819002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776570-3d40-4606-ae51-862b09d43d03 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:56.819117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b776570-3d40-4606-ae51-862b09d43d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:56.836748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3b776570-3d40-4606-ae51-862b09d43d03 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:48:56.837964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3b776570-3d40-4606-ae51-862b09d43d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:56.846589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1176/2364] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:48:56.867604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:48:56.869148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:48:56.885336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da5ac7-02fc-44f3-a789-5f2f0a950aec service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:48:56.890987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:48:56.891662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:48:56.891943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:48:56.892216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:48:56.901113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:48:56.902684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:48:56.912675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1189/2365] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:00.118234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8f2ba-7ad2-4220-91ab-1c4e807ccd65 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:00.118687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8f2ba-7ad2-4220-91ab-1c4e807ccd65 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:00.118796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8f2ba-7ad2-4220-91ab-1c4e807ccd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:00.137009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9bd8f2ba-7ad2-4220-91ab-1c4e807ccd65 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:00.138202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9bd8f2ba-7ad2-4220-91ab-1c4e807ccd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:00.196392 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1177/2366] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:49:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:00.241440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:00.243220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:00.312820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4308dc23-19f6-4ee8-a6ae-ac7f40f37733 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:00.318352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:00.318990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:00.319300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:00.319596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:00.327678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:00.329287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:00.337241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1190/2367] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:49:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:49:01.144763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77650382-b74c-42a2-8ad5-8df3fa0e8a19 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:01.145641 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77650382-b74c-42a2-8ad5-8df3fa0e8a19 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:01.146123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77650382-b74c-42a2-8ad5-8df3fa0e8a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:01.203290 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-77650382-b74c-42a2-8ad5-8df3fa0e8a19 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:01.204869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-77650382-b74c-42a2-8ad5-8df3fa0e8a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:01.224394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1178/2368] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:01.249204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:01.264181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621d5f5-3816-4cf4-9a53-0390f9e6c192 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:01.271771 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:01.272445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:01.272986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:01.273270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:01.282714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:01.284629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:01.296258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1191/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:05.309206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d007fe8-425e-4efd-a329-35229e0bd6f5 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:05.309743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d007fe8-425e-4efd-a329-35229e0bd6f5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:05.309983 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d007fe8-425e-4efd-a329-35229e0bd6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:05.329949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4d007fe8-425e-4efd-a329-35229e0bd6f5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:05.331454 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4d007fe8-425e-4efd-a329-35229e0bd6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:05.340208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1179/2370] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:49:05.370192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:05.383110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c535a5-e9c3-44ad-92a4-d1c0eb1a6cad service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:05.389442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97617681-a26f-4641-88de-787490e93c4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:05.390099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97617681-a26f-4641-88de-787490e93c4c service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:05.390403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97617681-a26f-4641-88de-787490e93c4c service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:05.390710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97617681-a26f-4641-88de-787490e93c4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:05.403825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97617681-a26f-4641-88de-787490e93c4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:05.406396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97617681-a26f-4641-88de-787490e93c4c service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:05.420128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1192/2371] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:09.523680 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c168-8b75-4453-943b-19d1d0c98eec None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:09.524326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c168-8b75-4453-943b-19d1d0c98eec None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:09.524326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29c168-8b75-4453-943b-19d1d0c98eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:09.547671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0e29c168-8b75-4453-943b-19d1d0c98eec None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:09.549388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0e29c168-8b75-4453-943b-19d1d0c98eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:09.560595 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1180/2372] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:09.589761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97617681-a26f-4641-88de-787490e93c4c service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:09.605742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97617681-a26f-4641-88de-787490e93c4c service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:09.614967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:09.615820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:09.616236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:09.616644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:09.629724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:09.631583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:09.643754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1193/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:13.742362 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265319b8-eca7-469a-acf8-1879832fceb4 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:13.742962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265319b8-eca7-469a-acf8-1879832fceb4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:13.742962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265319b8-eca7-469a-acf8-1879832fceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:13.763137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-265319b8-eca7-469a-acf8-1879832fceb4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:13.764564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-265319b8-eca7-469a-acf8-1879832fceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:13.773492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1181/2374] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:13.798996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:13.817919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abedd1-02ac-4713-9600-0e11240073f2 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:13.831756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:13.832429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:13.832712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:13.832987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:13.852326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:13.854373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:13.868820 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1194/2375] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:15.638836 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:15.639746 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:15.640270 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:15.660326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:15.661521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:15.668812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1182/2376] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 13:49:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:15.682440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:15.694324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f95fe-5218-4c93-be59-ce09cc8860ca service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:15.699748 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:15.700376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:15.700682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:15.700956 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:15.709049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:15.710621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:15.718834 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1195/2377] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:49:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:49:17.642115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:17.643643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:17.652634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=74 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:17.659632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a63d8-1cfb-4523-8aff-a4961fcd5d69 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:17.665372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:17.666221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:17.666507 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:17.666783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] PATH_INFO: `/v3/users/0976327ab67542afae1d719b9af2eb1e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:17.668033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0976327ab67542afae1d719b9af2eb1e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:17.669965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:17.715877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0976327ab67542afae1d719b9af2eb1e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:17.716516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0976327ab67542afae1d719b9af2eb1e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:17.723248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0976327ab67542afae1d719b9af2eb1e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:17.723896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0976327ab67542afae1d719b9af2eb1e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:17.735510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0bb2226a-a9d1-4db0-98ab-0f448ad6922e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0976327ab67542afae1d719b9af2eb1e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:17.748802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1183/2378] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:49:17 2022] DELETE /identity/v3/users/0976327ab67542afae1d719b9af2eb1e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:49:17.986145 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.012646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e4a94-b969-4e3b-8519-54d2267b2ee5 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.029427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:18.092029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.092932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.093219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.093500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] PATH_INFO: `/v3/projects/d179daa4c6314d2c98a790743d309f5c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.094685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d179daa4c6314d2c98a790743d309f5c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.096637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.143339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd179daa4c6314d2c98a790743d309f5c', 'request_id': 'req-c3a32999-052b-4cd1-9681-373a0b937bde'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:18.149396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd179daa4c6314d2c98a790743d309f5c', 'request_id': 'req-c3a32999-052b-4cd1-9681-373a0b937bde'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:18.156842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd179daa4c6314d2c98a790743d309f5c', 'request_id': 'req-c3a32999-052b-4cd1-9681-373a0b937bde'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:18.167227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] The token cache is being invalidate because project d179daa4c6314d2c98a790743d309f5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:49:18.167540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:18.168166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3a32999-052b-4cd1-9681-373a0b937bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:18.169692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1196/2379] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:49:17 2022] DELETE /identity/v3/projects/d179daa4c6314d2c98a790743d309f5c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:49:18.175032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.175342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.175631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.193799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:18.195000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:18.253258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1184/2380] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:18.260542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.260855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.261138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.279051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:18.280372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:18.288195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1197/2381] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:18.292112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.302148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe25911-164e-4324-85c3-083b9f6d3c82 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.306711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.307390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.307698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.307966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.308696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:49:18.309006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.310591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.322623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1185/2382] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:49:18.326654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.336139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e42659-5938-4d5a-827d-2e17b94843eb None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.341346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.342069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.342424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.342830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.343632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.346044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.371213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1198/2383] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:49:18 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:49:18.375286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.385271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344ea77-acf2-4af7-aa0f-8aea174533cd admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.440383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.441077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.441364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.441643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.442337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.444349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.451671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:18.464688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1186/2384] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:49:18 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:49:18.469271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.479473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb3b2-f8e5-47ea-872a-2c6b4d14eb57 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.484117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.485376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.485660 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.485941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.486666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.488308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.498590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1199/2385] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:49:18.502267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.512053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb1de-5842-400a-998f-e7255c657351 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.516645 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba10257a-07ff-4ba7-a7ac-875485eb7460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.517288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10257a-07ff-4ba7-a7ac-875485eb7460 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.517574 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10257a-07ff-4ba7-a7ac-875485eb7460 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.517852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba10257a-07ff-4ba7-a7ac-875485eb7460 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.518584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10257a-07ff-4ba7-a7ac-875485eb7460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.520203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba10257a-07ff-4ba7-a7ac-875485eb7460 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.529761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1187/2386] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:49:18.534065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.543936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7be39-f3bd-49e2-adb0-85dc95fd3c4d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.549157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.550028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.550322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.550604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] PATH_INFO: `/v3/projects/e7e17b81ab3e4d8d97e164af37084f84/users/de88e525770f419c900175cc1605ce6b/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.565372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e17b81ab3e4d8d97e164af37084f84, user_id=de88e525770f419c900175cc1605ce6b, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.568077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.580516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1200/2387] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:49:18 2022] PUT /identity/v3/projects/e7e17b81ab3e4d8d97e164af37084f84/users/de88e525770f419c900175cc1605ce6b/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:49:18.645984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.646502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.646502 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.673879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] MFA Rules not processed for user `de88e525770f419c900175cc1605ce6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:18.675092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:18.737028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1188/2388] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:49:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:18.748009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:18.749671 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:18.794908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:18.806924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d4728-f0f5-43ab-bc07-aadabdc56ae6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:18.810851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ca310-f84c-4e13-8a5e-238fe7d26cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:18.811523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca310-f84c-4e13-8a5e-238fe7d26cff service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:18.811805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca310-f84c-4e13-8a5e-238fe7d26cff service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:18.812077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ca310-f84c-4e13-8a5e-238fe7d26cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:18.820421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ca310-f84c-4e13-8a5e-238fe7d26cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:18.821844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ca310-f84c-4e13-8a5e-238fe7d26cff service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:18.831219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1201/2389] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:21.355772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:21.416400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764b95-03d2-4f68-9144-d0a62b15d1d1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:21.420767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:21.421624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:21.421903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:21.422181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] PATH_INFO: `/v3/users/de88e525770f419c900175cc1605ce6b` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:21.424015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=de88e525770f419c900175cc1605ce6b)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:21.425922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:21.473003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de88e525770f419c900175cc1605ce6b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:21.473717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de88e525770f419c900175cc1605ce6b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:21.481298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de88e525770f419c900175cc1605ce6b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:21.482002 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de88e525770f419c900175cc1605ce6b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:21.494196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:21.495682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de88e525770f419c900175cc1605ce6b'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:21.509137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1189/2390] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:49:21 2022] DELETE /identity/v3/users/de88e525770f419c900175cc1605ce6b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:49:21.513531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:21.514013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:21.514127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:21.531311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:21.533068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:21.603621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1202/2391] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:21.605346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:21.606835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:21.669036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5493e1-9dfe-4d44-aee4-e959dc1a84fe admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:21.673138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33fd6d4-1754-46a6-9a07-53a44b833a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:21.673792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fd6d4-1754-46a6-9a07-53a44b833a60 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:21.674077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fd6d4-1754-46a6-9a07-53a44b833a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:21.674355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33fd6d4-1754-46a6-9a07-53a44b833a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:21.684325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fd6d4-1754-46a6-9a07-53a44b833a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:21.685770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33fd6d4-1754-46a6-9a07-53a44b833a60 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:21.695923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1190/2392] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:21.967227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:21.968832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:21.982459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba09e83-9256-438d-bce0-e1beb0632355 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:21.995645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:21.996537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:21.996831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:21.997113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] PATH_INFO: `/v3/projects/e7e17b81ab3e4d8d97e164af37084f84` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:21.998331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e17b81ab3e4d8d97e164af37084f84)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:22.000298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:22.047073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e17b81ab3e4d8d97e164af37084f84', 'request_id': 'req-8a52cd70-024b-4e99-990d-dac5ad909766'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:22.054018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e17b81ab3e4d8d97e164af37084f84', 'request_id': 'req-8a52cd70-024b-4e99-990d-dac5ad909766'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:22.061416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e17b81ab3e4d8d97e164af37084f84', 'request_id': 'req-8a52cd70-024b-4e99-990d-dac5ad909766'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:22.071627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] The token cache is being invalidate because project e7e17b81ab3e4d8d97e164af37084f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:49:22.071915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:22.072531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8a52cd70-024b-4e99-990d-dac5ad909766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:49:22.074080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1203/2393] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:49:21 2022] DELETE /identity/v3/projects/e7e17b81ab3e4d8d97e164af37084f84 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:49:31.691714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=29,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:32.068616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:32.214412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:32.214812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:32.215213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:32.245876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] MFA Rules not processed for user `90a88fd9677a4ac7bb905e1605098737`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:32.247014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:32.317708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1191/2394] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:49:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:42.315603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=37 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:50.489182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763bca-1cd9-4c47-b827-3d86de17f6f2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:50.489740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763bca-1cd9-4c47-b827-3d86de17f6f2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:50.489851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8763bca-1cd9-4c47-b827-3d86de17f6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:50.561343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d8763bca-1cd9-4c47-b827-3d86de17f6f2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:50.562560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d8763bca-1cd9-4c47-b827-3d86de17f6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:50.651594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1204/2395] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:50.677287 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:50.678668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:50.798601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98ad05-1cb6-482e-9ed4-6b3be98051c3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:50.805519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344fab5-d8a1-44a5-97fd-b4d8ebd348f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:50.806193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344fab5-d8a1-44a5-97fd-b4d8ebd348f0 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:50.806482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344fab5-d8a1-44a5-97fd-b4d8ebd348f0 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:50.806763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344fab5-d8a1-44a5-97fd-b4d8ebd348f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:50.816620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344fab5-d8a1-44a5-97fd-b4d8ebd348f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:50.818214 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344fab5-d8a1-44a5-97fd-b4d8ebd348f0 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:50.829692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1192/2396] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:52.377755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:52.378218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:52.378378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:52.396836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] MFA Rules not processed for user `aaf5f62cbda949e88276b256b70fb459`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:52.398040 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:52.459685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1205/2397] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:49:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:55.900281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83362-f2d2-45a9-942c-9fd0132360dc None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:55.901163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83362-f2d2-45a9-942c-9fd0132360dc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:55.901441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be83362-f2d2-45a9-942c-9fd0132360dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:55.921239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6be83362-f2d2-45a9-942c-9fd0132360dc None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:55.922826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6be83362-f2d2-45a9-942c-9fd0132360dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:55.932000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1193/2398] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:55.951658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:55.965765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0c8e9-626c-4e4e-8374-87508abd2619 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:55.974684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:55.975387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:55.975676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:55.976222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:55.985594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:55.988008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:55.999963 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1206/2399] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:49:59.719815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecbf21-a5ec-4364-8fd0-61c4e691f016 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:59.720262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecbf21-a5ec-4364-8fd0-61c4e691f016 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:59.720381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecbf21-a5ec-4364-8fd0-61c4e691f016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:59.749769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-97ecbf21-a5ec-4364-8fd0-61c4e691f016 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:49:59.750993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-97ecbf21-a5ec-4364-8fd0-61c4e691f016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:59.809730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1194/2400] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:49:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:49:59.821931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:49:59.823727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:49:59.860519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:49:59.901355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c0fde-76a1-4cbc-b30f-ea0fc0fb440f service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:49:59.906489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:49:59.907302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:49:59.907619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:49:59.907898 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:49:59.916943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:49:59.918532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:49:59.926518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1207/2401] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:49:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 13:50:01.022041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714f27f-1cee-4005-98b9-fded4940bcf8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:01.022596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714f27f-1cee-4005-98b9-fded4940bcf8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:01.022596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714f27f-1cee-4005-98b9-fded4940bcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:01.047395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4714f27f-1cee-4005-98b9-fded4940bcf8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:01.049723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4714f27f-1cee-4005-98b9-fded4940bcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:01.060871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1195/2402] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:01.082982 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:01.086763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:01.107045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148fbef-499d-4e04-b62c-03c0d814323c service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:01.112587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:01.113328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:01.113710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:01.114035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:01.124663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:01.126476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:01.138641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1208/2403] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:06.334658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1f7c-f01d-4687-a070-18f8ef8f90b5 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:06.335202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1f7c-f01d-4687-a070-18f8ef8f90b5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:06.335348 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a1f7c-f01d-4687-a070-18f8ef8f90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:06.387249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4d1a1f7c-f01d-4687-a070-18f8ef8f90b5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:06.391262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4d1a1f7c-f01d-4687-a070-18f8ef8f90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:06.410318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1196/2404] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:06.433954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:06.447883 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ee590-6583-456f-8e3a-9c0baaec9b1e service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:06.454412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:06.455602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:06.455998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:06.456408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:06.466636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:06.468591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:06.504359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1209/2405] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:11.613256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:11.614424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:11.614424 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:11.631895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:11.633106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:11.640992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1197/2406] 10.222.0.40 () {58 vars in 1016 bytes} [Wed Jul 6 13:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:11.677553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:11.688798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3727c22-a694-4ec7-8f54-3825d6339190 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:11.694190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc4927-e5d6-4b05-94de-db6215d97087 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:11.694826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4927-e5d6-4b05-94de-db6215d97087 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:11.695108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4927-e5d6-4b05-94de-db6215d97087 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:11.695418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc4927-e5d6-4b05-94de-db6215d97087 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:11.703599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4927-e5d6-4b05-94de-db6215d97087 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:11.705186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dc4927-e5d6-4b05-94de-db6215d97087 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:11.720392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1210/2407] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:16.289760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:16.291168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:16.294800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:16.379372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ec3dc-f95a-4946-b14d-7ce1f47720f8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:16.384776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:16.385426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:16.385713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:16.385993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:16.387763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:16.399340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:16.400931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ed156-e8a0-449b-8c95-07106e6ef5c9 service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:16.410573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1198/2408] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:18.019415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd72bb-66b3-4db4-9bea-40046f6ac412 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.019891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd72bb-66b3-4db4-9bea-40046f6ac412 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.020281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd72bb-66b3-4db4-9bea-40046f6ac412 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.022318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1211/2409] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:50:18.028447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26cec-7cd3-42e4-8e4b-337da650f1f0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.028916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26cec-7cd3-42e4-8e4b-337da650f1f0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.029022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26cec-7cd3-42e4-8e4b-337da650f1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.072388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-13a26cec-7cd3-42e4-8e4b-337da650f1f0 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:18.073855 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-13a26cec-7cd3-42e4-8e4b-337da650f1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:18.084043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1199/2410] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:18.095666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd72bb-66b3-4db4-9bea-40046f6ac412 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:18.097394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-90cd72bb-66b3-4db4-9bea-40046f6ac412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:18.179783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd72bb-66b3-4db4-9bea-40046f6ac412 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:18.183273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e556f9d-6ae3-454b-97c3-8f186923af7c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:18.183949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556f9d-6ae3-454b-97c3-8f186923af7c service glance] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.184229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556f9d-6ae3-454b-97c3-8f186923af7c service glance] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.184503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e556f9d-6ae3-454b-97c3-8f186923af7c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.195072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e556f9d-6ae3-454b-97c3-8f186923af7c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:18.196536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e556f9d-6ae3-454b-97c3-8f186923af7c service glance] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:18.207056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1212/2411] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:18.272967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38401aa-ede6-4e96-b69f-f5b486d81625 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.273256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38401aa-ede6-4e96-b69f-f5b486d81625 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.273547 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38401aa-ede6-4e96-b69f-f5b486d81625 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.274886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1200/2412] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:50:18.279576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9c6c-95e6-40a3-b8d0-bcfc596f2a26 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.279894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9c6c-95e6-40a3-b8d0-bcfc596f2a26 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.280175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a9c6c-95e6-40a3-b8d0-bcfc596f2a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.309627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ad3a9c6c-95e6-40a3-b8d0-bcfc596f2a26 None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:18.310809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ad3a9c6c-95e6-40a3-b8d0-bcfc596f2a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:18.354061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:18.371208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1213/2413] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:18.383554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38401aa-ede6-4e96-b69f-f5b486d81625 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:18.385230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c38401aa-ede6-4e96-b69f-f5b486d81625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:18.399621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38401aa-ede6-4e96-b69f-f5b486d81625 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:18.403007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d23ec6-ec17-4114-ba0b-083d95165e33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:18.403670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23ec6-ec17-4114-ba0b-083d95165e33 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.403951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23ec6-ec17-4114-ba0b-083d95165e33 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.404224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d23ec6-ec17-4114-ba0b-083d95165e33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.411100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23ec6-ec17-4114-ba0b-083d95165e33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:18.412543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d23ec6-ec17-4114-ba0b-083d95165e33 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:18.420070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1201/2414] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:18.501686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6114730-30e8-4c26-8d19-2de698f2a14f None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.501981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6114730-30e8-4c26-8d19-2de698f2a14f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.502266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6114730-30e8-4c26-8d19-2de698f2a14f None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.503707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1214/2415] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:50:18.510224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e04d2d-1df2-4691-9843-405bf8cc2fa1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.510516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e04d2d-1df2-4691-9843-405bf8cc2fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.510794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e04d2d-1df2-4691-9843-405bf8cc2fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.531010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a2e04d2d-1df2-4691-9843-405bf8cc2fa1 None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:18.532235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a2e04d2d-1df2-4691-9843-405bf8cc2fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:18.541354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1202/2416] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:18.551733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6114730-30e8-4c26-8d19-2de698f2a14f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:18.553896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d6114730-30e8-4c26-8d19-2de698f2a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:18.569115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6114730-30e8-4c26-8d19-2de698f2a14f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:18.572705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:18.573333 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:18.573614 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:18.573887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:18.583733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:18.585154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:18.595994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1215/2417] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:25.786258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:25.786713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:25.786820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:25.839911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:25.841166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:25.857995 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1203/2418] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:50:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:25.870732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:25.891260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33438e-750e-4775-9151-8e36aca9e445 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:25.896320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:25.896957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:25.897244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:25.897527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:25.905493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:25.907082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:25.915499 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1216/2419] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:50:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:50:35.855110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=76 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:35.911864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=21 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:46.119243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.120754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:46.135234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0038df-0041-41d8-800c-2a1efd5e7e95 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.139717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.140587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.140892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.141184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] PATH_INFO: `/v3/users/90a88fd9677a4ac7bb905e1605098737` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.142386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90a88fd9677a4ac7bb905e1605098737)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.144333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.189898 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90a88fd9677a4ac7bb905e1605098737'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.190566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90a88fd9677a4ac7bb905e1605098737'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.197827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90a88fd9677a4ac7bb905e1605098737'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.198479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90a88fd9677a4ac7bb905e1605098737'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.209887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-68ef54a3-8366-4ccf-b6d2-364c8b73ede8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90a88fd9677a4ac7bb905e1605098737'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.222985 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1204/2420] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:50:46 2022] DELETE /identity/v3/users/90a88fd9677a4ac7bb905e1605098737 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:50:46.393621 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.409599 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fece20-d566-4e34-8de2-fbd416b964ba service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.465749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.466612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.466896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.467172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] PATH_INFO: `/v3/projects/ad1b6eb00a42458da083b38202669f10` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.468378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1b6eb00a42458da083b38202669f10)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.470303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.514713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1b6eb00a42458da083b38202669f10', 'request_id': 'req-8c22c36c-09d0-4970-95ba-d081a29cad2d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.520657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1b6eb00a42458da083b38202669f10', 'request_id': 'req-8c22c36c-09d0-4970-95ba-d081a29cad2d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.528193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1b6eb00a42458da083b38202669f10', 'request_id': 'req-8c22c36c-09d0-4970-95ba-d081a29cad2d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.538622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] The token cache is being invalidate because project ad1b6eb00a42458da083b38202669f10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:50:46.538904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.539558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8c22c36c-09d0-4970-95ba-d081a29cad2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:46.541117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1217/2421] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:50:46 2022] DELETE /identity/v3/projects/ad1b6eb00a42458da083b38202669f10 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:50:46.546051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.546340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.546616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.564749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:46.565941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:46.625188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1205/2422] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:46.632856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.633151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.633434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.652175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:46.653388 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:46.661394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1218/2423] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:46.665811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.675646 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7042eeb-c78a-4909-997a-3eccb1ed862a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.680446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.681195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.681489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.682333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.683102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:50:46.683440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.685101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.697804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1206/2424] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:50:46.702341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.712001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34389f33-e0d5-43e7-b8d4-e6cb4ed273ac None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.717008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.717672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.717955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.718235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.718939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.720892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.749919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1219/2425] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:50:46 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:50:46.751020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.761662 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d43c-68e5-4199-b45b-4b97f1bcb585 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.816597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.817262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.817542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.817816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.818500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.820425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.827542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:46.842430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1207/2426] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:50:46 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:50:46.846459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.856821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e79f2b-6572-4b16-828d-64b2ad653566 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.861393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.862041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.862323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.862598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.863364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.864955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.875767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1220/2427] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:50:46.879688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.890051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936db7-dfa8-4ebe-aad7-3ce95093fb8f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.894553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf31110-8eb2-4450-bf10-da608c0d5c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.895198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31110-8eb2-4450-bf10-da608c0d5c25 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.895522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31110-8eb2-4450-bf10-da608c0d5c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.895854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31110-8eb2-4450-bf10-da608c0d5c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.896508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31110-8eb2-4450-bf10-da608c0d5c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.898078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf31110-8eb2-4450-bf10-da608c0d5c25 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.907649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1208/2428] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:50:46.911670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:46.922122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea12b55-b865-4667-abbe-01c2692dff79 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:46.926669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:46.927571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.927858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.928137 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] PATH_INFO: `/v3/projects/167fefd5832c42a3a80ad29e45249583/users/65e4b94d10294532a2ab0145cf13333b/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.944385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] RBAC: Authorizing `identity:create_grant(project_id=167fefd5832c42a3a80ad29e45249583, user_id=65e4b94d10294532a2ab0145cf13333b, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:46.947033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:46.960120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1221/2429] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:50:46 2022] PUT /identity/v3/projects/167fefd5832c42a3a80ad29e45249583/users/65e4b94d10294532a2ab0145cf13333b/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:50:46.970346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7b7fc-319e-4b8d-a755-1655986c9cbf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:46.970658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7b7fc-319e-4b8d-a755-1655986c9cbf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:46.970934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7b7fc-319e-4b8d-a755-1655986c9cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:46.998007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-63f7b7fc-319e-4b8d-a755-1655986c9cbf None None] MFA Rules not processed for user `65e4b94d10294532a2ab0145cf13333b`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:46.999206 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-63f7b7fc-319e-4b8d-a755-1655986c9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:47.062388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1209/2430] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:47.073889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:47.075584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:47.106606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:47.160399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e5a5b-f1c8-4772-ac5b-7c5152e2d65d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:47.164369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:47.165019 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:47.165338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:47.165620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:47.174730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:47.176192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:47.185546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1222/2431] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:52.084236 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:52.084717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:52.084820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:52.102895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:52.104816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:52.130788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:52.158401 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1210/2432] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 13:50:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:52.171747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:52.173184 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:52.193312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ccd8-271f-42cd-9169-e204ce48062d service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:52.198310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:52.199175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:52.199490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:52.199764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] PATH_INFO: `/v3/users/65e4b94d10294532a2ab0145cf13333b` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:52.200936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e4b94d10294532a2ab0145cf13333b)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:52.202849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:52.250489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e4b94d10294532a2ab0145cf13333b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.256135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:52.261387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1207b-e766-43b6-98b9-3ae32dba205e None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:52.264604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e4b94d10294532a2ab0145cf13333b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.267927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:52.268572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:52.268853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:52.269129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:52.271710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e4b94d10294532a2ab0145cf13333b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.272541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e4b94d10294532a2ab0145cf13333b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.273372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-b597b335-6849-4c0c-9bf1-bf7462868b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e4b94d10294532a2ab0145cf13333b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.277844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:52.279505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:52.287376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1223/2433] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:50:52 2022] DELETE /identity/v3/users/65e4b94d10294532a2ab0145cf13333b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:50:52.287924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1211/2434] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:50:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 13:50:52.291577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:52.291797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:52.292077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:52.309847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:50:52.310868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:52.336088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:50:52.375578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1224/2435] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:50:52.386607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:52.388014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:52.454000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e7b7a-5a9d-4068-b7db-d5227355ab2d service swift] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:52.507724 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:52.508382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:52.508666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:52.508940 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:52.519882 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:52.522125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:52.536564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1212/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:50:52.889118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:50:52.890955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:50:52.907914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59792b1d-d725-4341-a8e0-ab97156c85e3 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:50:52.913124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:50:52.914204 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:50:52.914509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:50:52.914788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] PATH_INFO: `/v3/projects/167fefd5832c42a3a80ad29e45249583` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:50:52.916680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=167fefd5832c42a3a80ad29e45249583)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:50:52.919080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:50:52.968571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167fefd5832c42a3a80ad29e45249583', 'request_id': 'req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.974636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167fefd5832c42a3a80ad29e45249583', 'request_id': 'req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.982699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167fefd5832c42a3a80ad29e45249583', 'request_id': 'req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.993014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] The token cache is being invalidate because project 167fefd5832c42a3a80ad29e45249583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:50:52.993300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.994513 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:50:52.996070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1225/2437] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:50:52 2022] DELETE /identity/v3/projects/167fefd5832c42a3a80ad29e45249583 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:51:02.530650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=50 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:02.989974 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:51:58.716832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:51:58.718526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:51:58.730428 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e3cb-7ac3-4d7e-b659-576b0e0ad60f service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:51:58.781388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:51:58.782127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:51:58.783778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:51:58.783778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:51:58.785521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:51:58.873364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:51:58.874819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c36e8-54a9-47c0-b7f6-bd795ab2f483 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:51:58.887030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1213/2438] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:00.073828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:00.075445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:00.088791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d0f0f-d9ef-40e9-b192-cbd41b14e8cc admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:00.093378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:00.094223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:00.094607 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:00.094985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:00.097147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:00.114104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:00.115680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0613f-dac0-4dec-a608-92f941df7790 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:00.128556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1226/2439] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:52:00.340820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:00.340820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:00.340820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:00.358301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] MFA Rules not processed for user `aaf5f62cbda949e88276b256b70fb459`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:52:00.359708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:00.422386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1214/2440] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:52:02.286153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:02.286626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:02.286717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:02.304157 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] MFA Rules not processed for user `2d912686df5d42a58f7369bd5d2b9d25`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:52:02.305359 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:02.358564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1227/2441] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:52:08.711359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:08.721561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e04818e-97ef-40bd-8f5b-963da99336b8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:08.725077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:08.725715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:08.725998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:08.726275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:08.728807 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:08.739448 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:08.740851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:08.749718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1215/2442] 10.222.0.25 () {60 vars in 1396 bytes} [Wed Jul 6 13:52:08 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:12.352104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=31 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:18.745624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=85 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:34.254765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:34.256313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:34.312924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969f3d8-648a-4f44-ad05-27377f9db43d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:34.316425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:34.317069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:34.317350 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:34.317622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:34.319370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:34.382559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:34.384329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d93836-1ad6-495f-b850-3474c05c8571 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:34.394710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1228/2443] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:38.195128 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:38.197847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:38.233855 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47cc08-1605-4eae-b86c-10efdc5cc2b8 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:38.240597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:38.241255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:38.241538 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:38.241811 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:38.244789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:38.268685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:38.270709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:38.290367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1216/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:41.134588 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:41.135091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:41.135191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:41.154096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] MFA Rules not processed for user `29bed120fba74e638d9e9fe1f6d37d46`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:52:41.155345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:41.162738 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1229/2445] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:52:41.462866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:41.472728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b780ee-30c7-4c50-ba7e-eb9538364437 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:41.476304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:41.476941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:41.477227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:41.477508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:41.479262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:41.488533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:41.491690 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:41.500880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1217/2446] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:41.809437 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:41.810531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:41.879949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6193a9b-a072-4249-ba32-9863efa41436 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:41.884775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:41.885419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:41.886265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:41.886537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:41.888293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:41.899185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:41.900787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:41.910410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1230/2447] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:43.694553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:43.703614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f173b390-85f1-4ff5-9b8c-820dca17810b service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:43.707501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:43.708251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:43.708604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:43.708961 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:43.710802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:43.721488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:43.723042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:43.732243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1218/2448] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:49.694326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:52:49.695936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:49.713009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884fa60-66e7-4c0b-b47b-b3b63ed2d2e1 service placement] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:52:49.718472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:52:49.719120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:52:49.719434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:52:49.719723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:52:49.721486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:52:49.735373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:52:49.736996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:52:49.748728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1231/2449] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:52:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:52:53.727838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=18 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:52:59.744170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:16.856688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:16.869674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bf862-6e75-4c4d-b3a2-af5f1658be91 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:16.875546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:16.876303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:16.876588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:16.876863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:16.878581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:16.889280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:16.891000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:16.899780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1219/2450] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:26.895697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:29.400787 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:29.410085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606aa62-138b-4a46-be3c-dd421ee7c71a service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:29.413626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:29.414924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:29.414924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:29.414924 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:29.416894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:29.478351 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:29.479815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:29.489918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1232/2451] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:32.921258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:32.932269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b779ae-2eb8-4fb3-9305-b6f7c9183d29 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:32.937786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:32.938426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:32.938710 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:32.938990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:32.943031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:32.955015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:32.956748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:32.969332 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1220/2452] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:32.978844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:32.983451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:32.996623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ec93a-d108-4f04-9c1a-22cbda918d28 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.001189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.002070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.002356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.002636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] PATH_INFO: `/v3/users/aaf5f62cbda949e88276b256b70fb459` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.003996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf5f62cbda949e88276b256b70fb459)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.006034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.053228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf5f62cbda949e88276b256b70fb459'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.065460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf5f62cbda949e88276b256b70fb459'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.072394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf5f62cbda949e88276b256b70fb459'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.073143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf5f62cbda949e88276b256b70fb459'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.073789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8dfed91a-3cd9-4193-b2c1-49f117c79675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf5f62cbda949e88276b256b70fb459'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.086234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1233/2453] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:53:32 2022] DELETE /identity/v3/users/aaf5f62cbda949e88276b256b70fb459 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:33.264265 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.281463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f742f27-f74a-401a-a4ba-9197d9d39096 service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.344342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.345282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.345562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.345832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] PATH_INFO: `/v3/projects/083ac36029824fcbad27fa8e51e26286` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.346999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083ac36029824fcbad27fa8e51e26286)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.348974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.394248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083ac36029824fcbad27fa8e51e26286', 'request_id': 'req-778cd276-61ee-4edb-9595-c063906eee13'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.399755 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083ac36029824fcbad27fa8e51e26286', 'request_id': 'req-778cd276-61ee-4edb-9595-c063906eee13'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.406245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083ac36029824fcbad27fa8e51e26286', 'request_id': 'req-778cd276-61ee-4edb-9595-c063906eee13'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.418781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] The token cache is being invalidate because project 083ac36029824fcbad27fa8e51e26286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:53:33.419064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.419705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-778cd276-61ee-4edb-9595-c063906eee13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:33.421232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1221/2454] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:53:33 2022] DELETE /identity/v3/projects/083ac36029824fcbad27fa8e51e26286 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:33.426095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.426424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.426715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.444536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:33.445845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:33.504451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1234/2455] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:33.512110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.512391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.512692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.531079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:33.532378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:33.540409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1222/2456] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:33.545094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.554589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e70c0-fb22-4c03-bd24-194558bddf19 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.559125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.559805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.560091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.560368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.561085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:53:33.561392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.562990 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.564463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:33.576551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1235/2457] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:53:33.580520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.590442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1686b-df01-42b8-ac17-5c19bf1acc03 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.595059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.595750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.596037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.596315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.597010 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.598930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.633791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1223/2458] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:53:33 2022] POST /identity/v3/projects => generated 357 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:33.637800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.647848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad20694-fe37-4705-8463-ab513aae9438 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.706751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.707460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.707782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.708067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.708843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.710776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.731177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1236/2459] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:53:33 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:33.735170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.745572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274ba67-cc32-42c9-a65f-233ea8e06861 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.755729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.756405 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.756691 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.756969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.757711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.759351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.770333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1224/2460] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:33.774415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.785001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7866-4499-4d37-a27a-048afa7da12b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.789819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449f0ee-8948-4d44-81bb-4d1cb970fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.790484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449f0ee-8948-4d44-81bb-4d1cb970fd2c admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.790799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449f0ee-8948-4d44-81bb-4d1cb970fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.791077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449f0ee-8948-4d44-81bb-4d1cb970fd2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.791962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449f0ee-8948-4d44-81bb-4d1cb970fd2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.793584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449f0ee-8948-4d44-81bb-4d1cb970fd2c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.806858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1237/2461] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:33.808066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.818400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac676974-0637-4efc-8310-40f8c6801e07 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:33.822935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:33.824389 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.824632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.824902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] PATH_INFO: `/v3/projects/b8b26b36893448e0ad854d0b23a2f7f1/users/96cf29047d174e5f9373037d959ad6e5/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.841511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b26b36893448e0ad854d0b23a2f7f1, user_id=96cf29047d174e5f9373037d959ad6e5, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:33.844187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:33.857197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1225/2462] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:33 2022] PUT /identity/v3/projects/b8b26b36893448e0ad854d0b23a2f7f1/users/96cf29047d174e5f9373037d959ad6e5/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:53:33.867950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:33.868243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:33.868521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:33.894608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] MFA Rules not processed for user `96cf29047d174e5f9373037d959ad6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:33.895840 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:33.959855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1238/2463] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:33 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:33.965330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:33.970947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:34.027573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc9584-ff31-4f07-bfa3-d7a6ca822f6a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.032231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.032883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.033169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.033466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.034137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.036065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.061693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1226/2464] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:53:33 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:34.065845 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.077470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9182d1-ab49-4d6a-bdc4-988f01490773 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.132244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.132912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.133198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.133476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.134159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.136106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.144417 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:34.157436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1239/2465] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:53:34 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:34.161536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.171756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782652f-81b7-41b1-afec-bbe9d6689020 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.176339 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.176989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.177274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.177550 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.178269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.179891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.190597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1227/2466] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:34.194713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.205951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2c4f0-870e-42f2-90d2-3700fb040771 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.210851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.211710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.212236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.212520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] PATH_INFO: `/v3/projects/a8af6ed3144744558ca481c9de641ee9/users/951ae50125d24a059aeb98730b985ad6/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.228101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8af6ed3144744558ca481c9de641ee9, user_id=951ae50125d24a059aeb98730b985ad6, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.231182 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.244791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1240/2467] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:34 2022] PUT /identity/v3/projects/a8af6ed3144744558ca481c9de641ee9/users/951ae50125d24a059aeb98730b985ad6/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:34.249462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.259384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210afd2a-b2a8-41ef-ad62-a491aaf96349 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.317347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfe4b5-0958-4c9e-be6d-7f11759d9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.318017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfe4b5-0958-4c9e-be6d-7f11759d9ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.318301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfe4b5-0958-4c9e-be6d-7f11759d9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.318579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfe4b5-0958-4c9e-be6d-7f11759d9ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.319307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfe4b5-0958-4c9e-be6d-7f11759d9ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.320968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfe4b5-0958-4c9e-be6d-7f11759d9ca3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.332098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1228/2468] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:34.336035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.346786 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff85e69-bc1b-4937-8bac-098135deb743 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.351758 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.352639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.352923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.353226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] PATH_INFO: `/v3/projects/a8af6ed3144744558ca481c9de641ee9/users/951ae50125d24a059aeb98730b985ad6/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.355743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8af6ed3144744558ca481c9de641ee9, user_id=951ae50125d24a059aeb98730b985ad6, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.358374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.368554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1241/2469] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:34 2022] PUT /identity/v3/projects/a8af6ed3144744558ca481c9de641ee9/users/951ae50125d24a059aeb98730b985ad6/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:34.378982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.379280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.379596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.405719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] MFA Rules not processed for user `951ae50125d24a059aeb98730b985ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:34.406933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:34.481384 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:34.489226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1229/2470] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:34 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:34.502450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.504413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:34.582713 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336feca-2065-4de0-97b9-8b38337e92e3 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.587457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.587457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.587783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.588073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.600048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.604506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.615828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1242/2471] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:34 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:53:34.697195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:34.709909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2174e28-cd6d-48dc-b3f4-83e4f046cf44 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:34.714281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b678fd-6224-4c61-8c89-614e0a1dd19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:34.715031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b678fd-6224-4c61-8c89-614e0a1dd19b service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:34.715418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b678fd-6224-4c61-8c89-614e0a1dd19b service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:34.715621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b678fd-6224-4c61-8c89-614e0a1dd19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:34.782460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b678fd-6224-4c61-8c89-614e0a1dd19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:34.783880 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b678fd-6224-4c61-8c89-614e0a1dd19b service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:34.793657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1230/2472] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:34 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:44.610959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:44.788774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=28 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:49.405719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:49.466789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c8554-03ba-42e7-8f85-636660334aa3 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:49.471241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:49.472143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:49.472433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:49.472711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] PATH_INFO: `/v3/users/96cf29047d174e5f9373037d959ad6e5` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:49.473891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=96cf29047d174e5f9373037d959ad6e5)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:49.475851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:49.521878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96cf29047d174e5f9373037d959ad6e5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:49.533356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96cf29047d174e5f9373037d959ad6e5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:49.539987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96cf29047d174e5f9373037d959ad6e5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:49.540628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96cf29047d174e5f9373037d959ad6e5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:49.541222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96cf29047d174e5f9373037d959ad6e5'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:49.554219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1243/2473] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:53:49 2022] DELETE /identity/v3/users/96cf29047d174e5f9373037d959ad6e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:49.559262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:49.559738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:49.559900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:49.577700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:49.578890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:49.635505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1231/2474] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:49.645096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:49.646473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:49.706338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92c9e6-95ea-40a2-a680-2176ced0eecd admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:49.709986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:49.710631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:49.710919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:49.711193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:49.721177 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:49.722605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:49.732792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1244/2475] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:50.003795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.005275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:50.017616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2445a0ce-ab18-404c-b119-beff6514ebe0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.022708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:50.023692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.024044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.024410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] PATH_INFO: `/v3/projects/b8b26b36893448e0ad854d0b23a2f7f1` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.025673 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b26b36893448e0ad854d0b23a2f7f1)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:50.028098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:50.074483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b26b36893448e0ad854d0b23a2f7f1', 'request_id': 'req-03d44841-d46f-4dc4-b4d8-8867ea982a80'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.079863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b26b36893448e0ad854d0b23a2f7f1', 'request_id': 'req-03d44841-d46f-4dc4-b4d8-8867ea982a80'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.085834 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b26b36893448e0ad854d0b23a2f7f1', 'request_id': 'req-03d44841-d46f-4dc4-b4d8-8867ea982a80'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.098330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] The token cache is being invalidate because project b8b26b36893448e0ad854d0b23a2f7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:53:50.098652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.099413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.100938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1232/2476] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:53:50 2022] DELETE /identity/v3/projects/b8b26b36893448e0ad854d0b23a2f7f1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:50.104958 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.115167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41200e4d-b4af-4d22-94d7-ab3783cdf9f2 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.132931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:50.173216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:50.174090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.174376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.174654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] PATH_INFO: `/v3/users/951ae50125d24a059aeb98730b985ad6` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.175857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=951ae50125d24a059aeb98730b985ad6)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:50.177783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:50.222915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951ae50125d24a059aeb98730b985ad6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.234456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951ae50125d24a059aeb98730b985ad6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.241146 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951ae50125d24a059aeb98730b985ad6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.241802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951ae50125d24a059aeb98730b985ad6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.242404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-23e023d2-f8c3-4013-a55b-5422be2de228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951ae50125d24a059aeb98730b985ad6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.254792 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1245/2477] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:53:50 2022] DELETE /identity/v3/users/951ae50125d24a059aeb98730b985ad6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:50.524376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.525806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:50.538445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d44841-d46f-4dc4-b4d8-8867ea982a80 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.596432 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:50.597300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.597584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.597861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] PATH_INFO: `/v3/projects/a8af6ed3144744558ca481c9de641ee9` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.599040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8af6ed3144744558ca481c9de641ee9)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:50.600987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:50.631930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:50.649663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8af6ed3144744558ca481c9de641ee9', 'request_id': 'req-0b6833c6-cf40-4b3e-ba18-c31418053ab5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.655423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8af6ed3144744558ca481c9de641ee9', 'request_id': 'req-0b6833c6-cf40-4b3e-ba18-c31418053ab5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.661874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8af6ed3144744558ca481c9de641ee9', 'request_id': 'req-0b6833c6-cf40-4b3e-ba18-c31418053ab5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.673705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] The token cache is being invalidate because project a8af6ed3144744558ca481c9de641ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:53:50.673991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.674607 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-0b6833c6-cf40-4b3e-ba18-c31418053ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:50.676199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1233/2478] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:53:50 2022] DELETE /identity/v3/projects/a8af6ed3144744558ca481c9de641ee9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:50.681086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.681567 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.681691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.700403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:50.701602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:50.759476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1246/2479] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:50.769116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.769342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.769623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.788868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:50.790068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:50.798025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1234/2480] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:50.802252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.812788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0bb30e-3a4f-48c8-b107-c7a7998d73e2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.817455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:50.818111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.818396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.818673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.819435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:53:50.819750 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:50.821354 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:50.833381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1247/2481] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:53:50.837941 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.847056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633645db-7fac-4dd9-9d7a-b58ef11fc346 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.851675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:50.852305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.852589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.852864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.853545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:50.855967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:50.883664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1235/2482] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:53:50 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:50.884880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.894605 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7c634-e7d0-4c68-87d1-99d30353092a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.921299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:50.953729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:50.954432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:50.954718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:50.955002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:50.955807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:50.957740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:50.978994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1248/2483] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:53:50 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:50.983609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:50.993850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33350ce8-acd2-489b-80f7-08a4851b7ed3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:50.999619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.000272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.000554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.000854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.001573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.003156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.016552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1236/2484] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:51.017727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.028380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa182f-833d-446a-8a33-9103b686875b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.033022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855d0ff-880d-424f-9c46-eb20ace51914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.033685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d0ff-880d-424f-9c46-eb20ace51914 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.034122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d0ff-880d-424f-9c46-eb20ace51914 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.034406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855d0ff-880d-424f-9c46-eb20ace51914 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.035132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855d0ff-880d-424f-9c46-eb20ace51914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.036790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855d0ff-880d-424f-9c46-eb20ace51914 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.047742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1249/2485] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:53:51.052071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.062853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164c3faa-9676-4d39-b0c1-42e6b54bf278 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.068157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.069053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.069337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.069615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] PATH_INFO: `/v3/projects/341161d7c8d947c7abd40598de875e32/users/7d676fd0c0314b708f055240fde37ac6/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.084388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341161d7c8d947c7abd40598de875e32, user_id=7d676fd0c0314b708f055240fde37ac6, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.087497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.101946 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1237/2486] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:51 2022] PUT /identity/v3/projects/341161d7c8d947c7abd40598de875e32/users/7d676fd0c0314b708f055240fde37ac6/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:51.112997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.113382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.113728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.140127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] MFA Rules not processed for user `7d676fd0c0314b708f055240fde37ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:51.141310 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:51.203702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1250/2487] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:53:51.208247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.269122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34c2da-df4a-4418-8f44-ab86da86f604 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.273671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.274313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.274596 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.274866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.275575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.278074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.302490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1238/2488] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:53:51 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:51.306547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.317949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471152a8-c1bb-4ebb-8c99-8cfe383f900d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.374493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.375158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.375490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.375772 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.376460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.378369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.398057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1251/2489] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:53:51 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:51.401441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.412096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89c5533-febe-4278-8e43-45f0ee1f1b30 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.416563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.417211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.417495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.417769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.419121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.420757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.431030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1239/2490] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:51.434817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.444705 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18893086-c998-4eb5-84a9-abdf2e99133d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.449356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20f9db-0bd5-42e7-a064-d250c6f64f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.450034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20f9db-0bd5-42e7-a064-d250c6f64f98 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.450315 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20f9db-0bd5-42e7-a064-d250c6f64f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.450593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20f9db-0bd5-42e7-a064-d250c6f64f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.451307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20f9db-0bd5-42e7-a064-d250c6f64f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.452906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20f9db-0bd5-42e7-a064-d250c6f64f98 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.462739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1252/2491] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:51.466944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.476851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a7f62-4e12-4e8c-a58a-55aef7fa585a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.482047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.482908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.483190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.483503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] PATH_INFO: `/v3/projects/0d47ea8578234921a7410bd13ba6728f/users/668232b5a14d4758a7a86468dba4960c/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.497571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d47ea8578234921a7410bd13ba6728f, user_id=668232b5a14d4758a7a86468dba4960c, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.500274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.509412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:51.514494 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1240/2492] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:51 2022] PUT /identity/v3/projects/0d47ea8578234921a7410bd13ba6728f/users/668232b5a14d4758a7a86468dba4960c/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:53:51.524522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.524814 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.525092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.551678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] MFA Rules not processed for user `668232b5a14d4758a7a86468dba4960c`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:51.552936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:51.556807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:51.617716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1253/2493] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:51.622318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.682532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8d3ef-890e-4618-85f2-a99baef54a26 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.687191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.687877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.688168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.688447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.689132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.691046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.716258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1241/2494] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:53:51 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:53:51.720172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.731056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f1bea-cf79-41b6-b546-aaa9e3985a73 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.787981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.787981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.787981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.787981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.788386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.790113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.810016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1254/2495] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:53:51 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:51.814083 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.825104 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb262bfa-4f0e-4fdc-b805-88742c63641a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.829838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.830487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.830775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.831052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.831819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.833411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.844769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1242/2496] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:51.848804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.859561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88e83-b8a0-426d-9729-b9724be51235 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.864190 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.865075 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.865366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.865633 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] PATH_INFO: `/v3/projects/861ab29d2f7b459cbd4232e7bc957edb/users/f23bb98dd3a44ca8a6069cab7885b97e/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.881569 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] RBAC: Authorizing `identity:create_grant(project_id=861ab29d2f7b459cbd4232e7bc957edb, user_id=f23bb98dd3a44ca8a6069cab7885b97e, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.884378 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.900536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1255/2497] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:51 2022] PUT /identity/v3/projects/861ab29d2f7b459cbd4232e7bc957edb/users/f23bb98dd3a44ca8a6069cab7885b97e/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:51.904874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:51.914999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da88b7b-e890-4c28-b742-67f58b059afb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:51.976269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f4700-851a-43fb-a9de-ba9f9047534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:51.976949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4700-851a-43fb-a9de-ba9f9047534d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:51.977235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4700-851a-43fb-a9de-ba9f9047534d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:51.977515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f4700-851a-43fb-a9de-ba9f9047534d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:51.978246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f4700-851a-43fb-a9de-ba9f9047534d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:51.979920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f4700-851a-43fb-a9de-ba9f9047534d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:51.993718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1243/2498] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:51.994884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:52.010776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4119ae9-0619-40db-9922-08ec1bb0851a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:52.015533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:52.016430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:52.016720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:52.017009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] PATH_INFO: `/v3/projects/861ab29d2f7b459cbd4232e7bc957edb/users/f23bb98dd3a44ca8a6069cab7885b97e/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:52.025742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861ab29d2f7b459cbd4232e7bc957edb, user_id=f23bb98dd3a44ca8a6069cab7885b97e, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:52.029420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:52.049186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1256/2499] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:51 2022] PUT /identity/v3/projects/861ab29d2f7b459cbd4232e7bc957edb/users/f23bb98dd3a44ca8a6069cab7885b97e/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:52.060805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:52.061050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:52.061336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:52.088952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] MFA Rules not processed for user `f23bb98dd3a44ca8a6069cab7885b97e`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:52.090669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:52.159951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:52.170410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1244/2500] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:52.181662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:52.183495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:52.245805 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bde74-cbc5-49e3-9753-b8c70eb42526 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:52.249486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:52.250151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:52.251056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:52.251056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:52.261941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:52.263522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:52.269387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:52.278971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1257/2501] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:52.327395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:52.328827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:52.341817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87178b-6a3b-4859-acbf-10ba09a51969 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:52.345475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0211ef9e-3797-482d-9134-00cb3692d543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:52.346156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ef9e-3797-482d-9134-00cb3692d543 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:52.346445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ef9e-3797-482d-9134-00cb3692d543 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:52.346725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0211ef9e-3797-482d-9134-00cb3692d543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:52.405218 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211ef9e-3797-482d-9134-00cb3692d543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:52.406660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0211ef9e-3797-482d-9134-00cb3692d543 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:52.415730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1245/2502] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:56.305976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:56.367339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b2af-0377-48e3-b66d-84b8879c825f service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:56.371812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:56.372674 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:56.372979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:56.373262 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] PATH_INFO: `/v3/users/7d676fd0c0314b708f055240fde37ac6` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:56.374470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d676fd0c0314b708f055240fde37ac6)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:56.376420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:56.425253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d676fd0c0314b708f055240fde37ac6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:56.438504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d676fd0c0314b708f055240fde37ac6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:56.445381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d676fd0c0314b708f055240fde37ac6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:56.446078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d676fd0c0314b708f055240fde37ac6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:56.446684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d676fd0c0314b708f055240fde37ac6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:56.460303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1258/2503] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:53:56 2022] DELETE /identity/v3/users/7d676fd0c0314b708f055240fde37ac6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:56.465529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d0c7-af99-422e-94a0-09f625806625 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:56.465978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d0c7-af99-422e-94a0-09f625806625 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:56.466090 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d0c7-af99-422e-94a0-09f625806625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:56.483531 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-4a44d0c7-af99-422e-94a0-09f625806625 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:56.484715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4a44d0c7-af99-422e-94a0-09f625806625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:56.543806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1246/2504] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:56.553302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:56.554768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:56.614553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02acb-422c-44b5-a34a-de96316c48e5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:56.618318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:56.618959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:56.619271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:56.619582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:56.629099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:56.630556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:56.641554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1259/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:53:56.706297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:56.706549 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:56.706825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:56.725973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:56.727219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:56.784351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1247/2506] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:53:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:56.837600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:56.839449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:56.870527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:56.923716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0213a-0816-49a7-85d2-6958bfe04847 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:56.929899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:56.930753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:56.931039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:56.931337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:56.942128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:56.944049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:56.944197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:56.945677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:56.954597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1260/2507] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:53:56.966487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5e7c4-aa96-49aa-bf6a-485fa36dc668 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:56.972693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:56.973675 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:56.974161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:56.974506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] PATH_INFO: `/v3/projects/341161d7c8d947c7abd40598de875e32` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:56.976015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=341161d7c8d947c7abd40598de875e32)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:56.978478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:57.057829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:57.075576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341161d7c8d947c7abd40598de875e32', 'request_id': 'req-57990f80-83b0-4a07-b5e4-500522015ed2'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.083019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341161d7c8d947c7abd40598de875e32', 'request_id': 'req-57990f80-83b0-4a07-b5e4-500522015ed2'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.089842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341161d7c8d947c7abd40598de875e32', 'request_id': 'req-57990f80-83b0-4a07-b5e4-500522015ed2'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.109093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] The token cache is being invalidate because project 341161d7c8d947c7abd40598de875e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:53:57.109418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.113661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.115881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1248/2508] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:53:56 2022] DELETE /identity/v3/projects/341161d7c8d947c7abd40598de875e32 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:53:57.119973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:57.133686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a6d68-bf76-43aa-bc98-7043ac6f10cb service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:57.200249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:57.202067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:57.202523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:57.202944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] PATH_INFO: `/v3/users/668232b5a14d4758a7a86468dba4960c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:57.204460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=668232b5a14d4758a7a86468dba4960c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:57.206723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:57.266431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '668232b5a14d4758a7a86468dba4960c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.286489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '668232b5a14d4758a7a86468dba4960c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.293785 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '668232b5a14d4758a7a86468dba4960c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.294594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '668232b5a14d4758a7a86468dba4960c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.295927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '668232b5a14d4758a7a86468dba4960c'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:57.311226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1261/2509] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:53:57 2022] DELETE /identity/v3/users/668232b5a14d4758a7a86468dba4960c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:57.901609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:57.903201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:57.920929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57990f80-83b0-4a07-b5e4-500522015ed2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:57.992044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:57.993954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:57.994242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:57.994521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] PATH_INFO: `/v3/projects/0d47ea8578234921a7410bd13ba6728f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:57.995752 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d47ea8578234921a7410bd13ba6728f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:57.997686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:58.064018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d47ea8578234921a7410bd13ba6728f', 'request_id': 'req-00d89585-620c-4944-89e7-ec3fcbf2399d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.072352 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d47ea8578234921a7410bd13ba6728f', 'request_id': 'req-00d89585-620c-4944-89e7-ec3fcbf2399d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.078992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d47ea8578234921a7410bd13ba6728f', 'request_id': 'req-00d89585-620c-4944-89e7-ec3fcbf2399d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.099283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] The token cache is being invalidate because project 0d47ea8578234921a7410bd13ba6728f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:53:58.099629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.100297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.106317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:58.106842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1249/2510] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:53:57 2022] DELETE /identity/v3/projects/0d47ea8578234921a7410bd13ba6728f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:58.108402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:58.124743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdd5d3-0c29-426b-8e29-ada57ea528f8 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:58.162933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:58.224401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:58.225612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:58.226063 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:58.226505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] PATH_INFO: `/v3/users/f23bb98dd3a44ca8a6069cab7885b97e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:58.228012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f23bb98dd3a44ca8a6069cab7885b97e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:58.230414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:58.293992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23bb98dd3a44ca8a6069cab7885b97e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.307290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23bb98dd3a44ca8a6069cab7885b97e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.315109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23bb98dd3a44ca8a6069cab7885b97e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.316309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23bb98dd3a44ca8a6069cab7885b97e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.317243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-fcb7d189-9544-46fe-b4a0-320c00c4983f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23bb98dd3a44ca8a6069cab7885b97e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.332402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1262/2511] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:53:58 2022] DELETE /identity/v3/users/f23bb98dd3a44ca8a6069cab7885b97e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:58.663075 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:58.664870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:58.684894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d89585-620c-4944-89e7-ec3fcbf2399d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:58.753373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:58.765598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:58.766718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:58.767165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:58.767684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] PATH_INFO: `/v3/projects/861ab29d2f7b459cbd4232e7bc957edb` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:58.772269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861ab29d2f7b459cbd4232e7bc957edb)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:58.772269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:58.837818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861ab29d2f7b459cbd4232e7bc957edb', 'request_id': 'req-475292db-6241-402c-8e5f-c8cb20972992'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.845230 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861ab29d2f7b459cbd4232e7bc957edb', 'request_id': 'req-475292db-6241-402c-8e5f-c8cb20972992'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.852793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861ab29d2f7b459cbd4232e7bc957edb', 'request_id': 'req-475292db-6241-402c-8e5f-c8cb20972992'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.867123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] The token cache is being invalidate because project 861ab29d2f7b459cbd4232e7bc957edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:53:58.867602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.869621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-475292db-6241-402c-8e5f-c8cb20972992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:53:58.871395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1250/2512] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:53:58 2022] DELETE /identity/v3/projects/861ab29d2f7b459cbd4232e7bc957edb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:53:58.880439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:58.880987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:58.881352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:58.904317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:58.906717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:58.980020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1263/2513] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:53:58.988300 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:58.988819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:58.989120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.010235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:59.011626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:59.021294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1251/2514] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:53:59.025343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.037158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5007f8-5bea-46fe-9972-3bf5e412fe3c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.042023 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.042886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.043474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.043843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.044652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:53:59.045568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.049665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.060600 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1264/2515] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:53:59.066766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.074663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da532847-ebc5-4c9b-b94e-6b233fa89156 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.080536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.081200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.081485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.081765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.082461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.086672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.116725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1252/2516] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:53:59 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:53:59.120764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.131933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235082b1-0499-4680-80b6-b8e96844e585 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.174474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:53:59.197500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.198186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.198472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.198751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.199470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.201475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.228954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1265/2517] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:53:59 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:53:59.233330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.248831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3bd4b-22ed-464f-afc5-2bc22f6a47ae admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.254136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.255910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.256198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.256472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.257210 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.258883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.273966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1253/2518] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:53:59.275365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.288615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e320832-3731-4cee-9680-2342ea9f6547 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.295652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab171ff-92c5-4b4e-81d6-f31c0dc44bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.296353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab171ff-92c5-4b4e-81d6-f31c0dc44bbc admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.297613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab171ff-92c5-4b4e-81d6-f31c0dc44bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.298028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab171ff-92c5-4b4e-81d6-f31c0dc44bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.298925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab171ff-92c5-4b4e-81d6-f31c0dc44bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.300572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab171ff-92c5-4b4e-81d6-f31c0dc44bbc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.317418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1266/2519] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:53:59.318666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.333161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78649a2c-8318-46d5-871a-84651ac733bd admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.340157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.341058 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.341359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.341648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] PATH_INFO: `/v3/projects/14d6d25369dd4778a4e84c576ee9bc89/users/ee1ba6c91f88482e9580a967451e3f8f/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.361870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d6d25369dd4778a4e84c576ee9bc89, user_id=ee1ba6c91f88482e9580a967451e3f8f, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.364570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.384778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1254/2520] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:53:59 2022] PUT /identity/v3/projects/14d6d25369dd4778a4e84c576ee9bc89/users/ee1ba6c91f88482e9580a967451e3f8f/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:53:59.396521 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.396827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.397081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.430353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] MFA Rules not processed for user `ee1ba6c91f88482e9580a967451e3f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:53:59.431625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:59.529573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1267/2521] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:53:59.541572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:53:59.543796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:53:59.607867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe06b0-979a-4fd0-9f49-f61f8c7aa0b4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:53:59.611438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c804c9-6af3-4f7f-a54a-f095800415e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:53:59.612081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c804c9-6af3-4f7f-a54a-f095800415e8 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:53:59.612361 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c804c9-6af3-4f7f-a54a-f095800415e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:53:59.612634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c804c9-6af3-4f7f-a54a-f095800415e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:53:59.622201 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c804c9-6af3-4f7f-a54a-f095800415e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:53:59.630019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c804c9-6af3-4f7f-a54a-f095800415e8 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:53:59.652920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1255/2522] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:53:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:05.188013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:05.264268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a1348f-c4c0-4068-b697-b8bd6be01bdb None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:05.268759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:05.269642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:05.269927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:05.270203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] PATH_INFO: `/v3/users/ee1ba6c91f88482e9580a967451e3f8f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:05.271407 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee1ba6c91f88482e9580a967451e3f8f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:05.273316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:05.327647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1ba6c91f88482e9580a967451e3f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:05.331631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:05.353105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1ba6c91f88482e9580a967451e3f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:05.362015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1ba6c91f88482e9580a967451e3f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:05.363552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1ba6c91f88482e9580a967451e3f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:05.364258 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1ba6c91f88482e9580a967451e3f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:05.380503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1268/2523] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:54:05 2022] DELETE /identity/v3/users/ee1ba6c91f88482e9580a967451e3f8f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:05.393279 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:05.393787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:05.393868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:05.416725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:05.418269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:05.439284 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:05.494313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1256/2524] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:05.505610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:05.507555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:05.580999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27d2e-e4e3-4d64-b044-8e83e5ed6bfe admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:05.585215 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f3f67-3fd0-463b-9ede-700aa231149b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:05.585871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3f67-3fd0-463b-9ede-700aa231149b service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:05.586156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3f67-3fd0-463b-9ede-700aa231149b service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:05.586489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f3f67-3fd0-463b-9ede-700aa231149b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:05.600757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f3f67-3fd0-463b-9ede-700aa231149b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:05.602494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f3f67-3fd0-463b-9ede-700aa231149b service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:05.613944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1269/2525] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:05.900014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:05.901612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:05.923522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5bb0-f3df-4d1a-aec6-cd6b0bb991ba None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:05.936044 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:05.936950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:05.937235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:05.937513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] PATH_INFO: `/v3/projects/14d6d25369dd4778a4e84c576ee9bc89` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:05.938860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d6d25369dd4778a4e84c576ee9bc89)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:05.940988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:05.996096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d6d25369dd4778a4e84c576ee9bc89', 'request_id': 'req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:06.000793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d6d25369dd4778a4e84c576ee9bc89', 'request_id': 'req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:06.007672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d6d25369dd4778a4e84c576ee9bc89', 'request_id': 'req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:06.021404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] The token cache is being invalidate because project 14d6d25369dd4778a4e84c576ee9bc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:54:06.021692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:06.022308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d501bb5a-c85c-4aea-a1fb-91ffa4a4fbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:06.023929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1257/2526] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:54:05 2022] DELETE /identity/v3/projects/14d6d25369dd4778a4e84c576ee9bc89 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:06.028779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.029654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.029932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.050021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:06.051214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:06.114162 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1270/2527] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:06.121819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.122143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.122319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.140643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:06.141822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:06.149529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1258/2528] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:06.153809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.164269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f1668-3a3b-4226-9a7b-68f006dea8b4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.168798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.169449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.169732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.170010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.170729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:54:06.171207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.172832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.184018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1271/2529] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:54:06.188608 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.197808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a7889-b4a8-484d-a560-e8f27d53c5a2 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.203585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.204237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.204521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.204796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.205489 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.207411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.232253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1259/2530] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:54:06 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:54:06.236434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.246166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393134bc-cc8f-459b-8fa2-106a8b11be25 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.294984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:06.302639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.303467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.304098 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.304391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.305426 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.307871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.328101 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1272/2531] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:54:06 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:54:06.332663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.343147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303c754e-89b6-4b53-9a37-081825afbff2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.347750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.348402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.348686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.348963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.349696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.351280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.361288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1260/2532] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:54:06.365085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.375172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee639d23-2e75-4554-80c1-b88954df2aab admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.379702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0da3b6-4465-4508-8dea-d2aeeedfa6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.380339 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da3b6-4465-4508-8dea-d2aeeedfa6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.380620 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da3b6-4465-4508-8dea-d2aeeedfa6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.380895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0da3b6-4465-4508-8dea-d2aeeedfa6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.381604 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0da3b6-4465-4508-8dea-d2aeeedfa6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.383172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0da3b6-4465-4508-8dea-d2aeeedfa6b2 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.393394 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1273/2533] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:06.397199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.407930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9456969-a6e2-449f-8c4a-1343de7d2697 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.412700 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.413571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.413853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.414126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] PATH_INFO: `/v3/projects/69d349236b8e48aeb322dd376ef75016/users/b7a95524fcdb466882e16a12a558409e/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.428294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69d349236b8e48aeb322dd376ef75016, user_id=b7a95524fcdb466882e16a12a558409e, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.430910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.445600 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1261/2534] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:54:06 2022] PUT /identity/v3/projects/69d349236b8e48aeb322dd376ef75016/users/b7a95524fcdb466882e16a12a558409e/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:06.456380 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed81ab-f1b8-45ff-a862-6d1b94f51aa1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.456675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed81ab-f1b8-45ff-a862-6d1b94f51aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.456962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed81ab-f1b8-45ff-a862-6d1b94f51aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.482672 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-3fed81ab-f1b8-45ff-a862-6d1b94f51aa1 None None] MFA Rules not processed for user `b7a95524fcdb466882e16a12a558409e`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:06.484127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3fed81ab-f1b8-45ff-a862-6d1b94f51aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:06.547065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1274/2535] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:06.557831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:06.559517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:06.608725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:06.621336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c191b2-06cd-4097-91ec-1c111d8302b6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:06.625889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce6a1-68f3-4869-8741-6715bf0d44fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:06.626537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce6a1-68f3-4869-8741-6715bf0d44fd service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:06.626819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce6a1-68f3-4869-8741-6715bf0d44fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:06.627091 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce6a1-68f3-4869-8741-6715bf0d44fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:06.636209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce6a1-68f3-4869-8741-6715bf0d44fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:06.637678 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce6a1-68f3-4869-8741-6715bf0d44fd service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:06.646692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1262/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:11.163533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f993804-ddfd-43da-a582-4f4bfdae5d30 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.164047 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f993804-ddfd-43da-a582-4f4bfdae5d30 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.164167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f993804-ddfd-43da-a582-4f4bfdae5d30 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.165682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1275/2537] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:54:11.172193 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d27c96-7580-4ee8-9cb9-e125c31ceecd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.172620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d27c96-7580-4ee8-9cb9-e125c31ceecd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.172864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d27c96-7580-4ee8-9cb9-e125c31ceecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.193309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-02d27c96-7580-4ee8-9cb9-e125c31ceecd None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:11.194546 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-02d27c96-7580-4ee8-9cb9-e125c31ceecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:11.263823 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1263/2538] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:11.275032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f993804-ddfd-43da-a582-4f4bfdae5d30 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:11.276954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3f993804-ddfd-43da-a582-4f4bfdae5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:11.334348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f993804-ddfd-43da-a582-4f4bfdae5d30 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:11.338136 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdeb92-1aec-4d26-a070-b29d9bae5d39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:11.338776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdeb92-1aec-4d26-a070-b29d9bae5d39 service glance] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.339061 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdeb92-1aec-4d26-a070-b29d9bae5d39 service glance] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.339360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdeb92-1aec-4d26-a070-b29d9bae5d39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.349248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdeb92-1aec-4d26-a070-b29d9bae5d39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:11.350631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdeb92-1aec-4d26-a070-b29d9bae5d39 service glance] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:11.361656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1276/2539] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:11.425743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3855a-60a1-4fc4-9d73-afcbf4a91bf1 None None] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.426040 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3855a-60a1-4fc4-9d73-afcbf4a91bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.426324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3855a-60a1-4fc4-9d73-afcbf4a91bf1 None None] PATH_INFO: `/` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.427733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1264/2540] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:54:11.432458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058ad2-e7fb-4ba0-8429-ffe4535e3d54 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.432749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058ad2-e7fb-4ba0-8429-ffe4535e3d54 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.433024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50058ad2-e7fb-4ba0-8429-ffe4535e3d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.451179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-50058ad2-e7fb-4ba0-8429-ffe4535e3d54 None None] MFA Rules not processed for user `f0dd5d8814384b14b46e8e6fd4fab9f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:11.452451 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-50058ad2-e7fb-4ba0-8429-ffe4535e3d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:11.510312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1277/2541] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:11.524036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3855a-60a1-4fc4-9d73-afcbf4a91bf1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:11.525816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b7d3855a-60a1-4fc4-9d73-afcbf4a91bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:11.541430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3855a-60a1-4fc4-9d73-afcbf4a91bf1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:11.545545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdea4f-6d1b-4609-a06b-7ebe936f4537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:11.546190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdea4f-6d1b-4609-a06b-7ebe936f4537 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.546473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdea4f-6d1b-4609-a06b-7ebe936f4537 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.546749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdea4f-6d1b-4609-a06b-7ebe936f4537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.554243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdea4f-6d1b-4609-a06b-7ebe936f4537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:11.555795 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdea4f-6d1b-4609-a06b-7ebe936f4537 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:11.563545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1265/2542] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:11.645441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4836e-91c5-45ed-a0e1-e1e9a6809645 None None] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.645800 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4836e-91c5-45ed-a0e1-e1e9a6809645 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.646031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e4836e-91c5-45ed-a0e1-e1e9a6809645 None None] PATH_INFO: `/` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.647863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1278/2543] 10.222.0.25 () {54 vars in 921 bytes} [Wed Jul 6 13:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 13:54:11.655387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a502-0607-490b-a8a3-44bdc6f96aca None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.655685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a502-0607-490b-a8a3-44bdc6f96aca None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.655967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436a502-0607-490b-a8a3-44bdc6f96aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.675061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f436a502-0607-490b-a8a3-44bdc6f96aca None None] MFA Rules not processed for user `943294440c3a4d309ff6e6165dcb9d32`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:11.676274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f436a502-0607-490b-a8a3-44bdc6f96aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:11.685356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1266/2544] 10.222.0.25 () {58 vars in 1018 bytes} [Wed Jul 6 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:11.695445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4836e-91c5-45ed-a0e1-e1e9a6809645 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:11.706420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e4836e-91c5-45ed-a0e1-e1e9a6809645 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:11.709952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:11.710584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:11.710867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:11.711150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:11.721854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:11.723281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:11.734502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1279/2545] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:13.485005 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f01aa-770b-4a95-8d7a-9fb061999120 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:13.485474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f01aa-770b-4a95-8d7a-9fb061999120 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:13.485685 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f01aa-770b-4a95-8d7a-9fb061999120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:13.506363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f69f01aa-770b-4a95-8d7a-9fb061999120 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:13.507668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f69f01aa-770b-4a95-8d7a-9fb061999120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:13.567982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1267/2546] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:13.582184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:13.583811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:13.589720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:13.657349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1608a9-dfe7-44e6-84b8-deb432b2f65b service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:13.662292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:13.662939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:13.663225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:13.663531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:13.671592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:13.673142 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:13.681131 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1280/2547] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:54:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:54:23.561357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=72 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:23.677920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=31 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:34.495050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:34.495604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:34.495736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:34.514333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:34.515630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:34.522695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1268/2548] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:34.535097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:34.545775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67cdb2-0f83-4bb0-aeb8-3f66f5d92f73 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:34.550717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79d905-5918-4ac2-9369-7d75e76cd235 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:34.551450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d905-5918-4ac2-9369-7d75e76cd235 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:34.551741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d905-5918-4ac2-9369-7d75e76cd235 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:34.552017 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79d905-5918-4ac2-9369-7d75e76cd235 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:34.560003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d905-5918-4ac2-9369-7d75e76cd235 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:34.561619 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79d905-5918-4ac2-9369-7d75e76cd235 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:34.570170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1281/2549] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:54:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:54:41.640827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:41.712503 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb52ee8-1823-476a-a54a-4220399759bd None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:41.717245 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:41.718186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:41.718536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:41.718881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] PATH_INFO: `/v3/users/b7a95524fcdb466882e16a12a558409e` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:41.720340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7a95524fcdb466882e16a12a558409e)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:41.722412 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:41.772976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7a95524fcdb466882e16a12a558409e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:41.773636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7a95524fcdb466882e16a12a558409e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:41.780847 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7a95524fcdb466882e16a12a558409e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:41.781490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7a95524fcdb466882e16a12a558409e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:41.795439 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7a95524fcdb466882e16a12a558409e'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:41.810651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1269/2550] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:54:41 2022] DELETE /identity/v3/users/b7a95524fcdb466882e16a12a558409e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:41.814951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:41.815464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:41.815694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:41.833885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:41.835093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:41.897250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1282/2551] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:41.907493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:41.908994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:41.967889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0127-34e4-47dd-a58c-fd237f8de309 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:41.971515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e2ab4-1471-4d92-b8e0-0a1b2fedcdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:41.972163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2ab4-1471-4d92-b8e0-0a1b2fedcdde service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:41.972445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2ab4-1471-4d92-b8e0-0a1b2fedcdde service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:41.972721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e2ab4-1471-4d92-b8e0-0a1b2fedcdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:41.981728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2ab4-1471-4d92-b8e0-0a1b2fedcdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:41.983164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e2ab4-1471-4d92-b8e0-0a1b2fedcdde service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:41.993761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1270/2552] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:42.286379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.287932 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:42.301441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675fc39e-588e-4f1e-b78f-e00e2b590bf9 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.306549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.307635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.307836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.308105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] PATH_INFO: `/v3/projects/69d349236b8e48aeb322dd376ef75016` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.309410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69d349236b8e48aeb322dd376ef75016)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.311977 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.361595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69d349236b8e48aeb322dd376ef75016', 'request_id': 'req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:42.367836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69d349236b8e48aeb322dd376ef75016', 'request_id': 'req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:42.375789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69d349236b8e48aeb322dd376ef75016', 'request_id': 'req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:42.385811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] The token cache is being invalidate because project 69d349236b8e48aeb322dd376ef75016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:54:42.386094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:42.386698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-95976f27-0995-40cc-a2d3-7f6fbe73f7a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:42.388895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1283/2553] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:54:42 2022] DELETE /identity/v3/projects/69d349236b8e48aeb322dd376ef75016 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:42.394018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.394308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.394587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.412293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:42.413484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:42.422630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:42.472456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1271/2554] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:42.532002 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.532288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.532563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.551846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:42.553030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:42.561405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1284/2555] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:42.565440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.575169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ceb8b3-8a5e-48ef-9696-6efd53aa88af None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.579844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.580701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.580848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.581069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.581772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:54:42.582101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.583701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.595334 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1272/2556] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:54:42.599500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.609110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724bf36-13c8-4ab0-8e2c-03340b0903aa None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.613630 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.614271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.614552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.614832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.615543 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.617424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.645708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1285/2557] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:54:42 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:54:42.646872 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.656805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ecd46-0c11-4404-a3ab-f3aa266d739e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.717437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.718110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.718393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.718668 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.719400 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.721316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.749110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1273/2558] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:54:42 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:54:42.750561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.760636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f46b8-74f4-4687-b7ca-8a25d1fd50ed admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.765365 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.766022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.766305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.766578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.767293 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.768936 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.779299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1286/2559] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:42.783225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.793222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab8cc4-a753-44f9-aa4c-757532b54f94 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.798363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee2f4b-b547-42df-bacb-9d2175c714e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.799022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2f4b-b547-42df-bacb-9d2175c714e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.799303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2f4b-b547-42df-bacb-9d2175c714e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.799605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee2f4b-b547-42df-bacb-9d2175c714e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.800342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee2f4b-b547-42df-bacb-9d2175c714e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.801930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee2f4b-b547-42df-bacb-9d2175c714e7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.816263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1274/2560] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:42.820384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.831291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30cdbe-36cd-4782-aa66-af883ba4f6ee admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:42.835879 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:42.837007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.837288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.837563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] PATH_INFO: `/v3/projects/24be71f6204d462f906aec1afe1dcf53/users/64d53c8fcbc14f99a15eb117fc74377d/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.857192 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] RBAC: Authorizing `identity:create_grant(project_id=24be71f6204d462f906aec1afe1dcf53, user_id=64d53c8fcbc14f99a15eb117fc74377d, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:42.859896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:42.879793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1287/2561] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:54:42 2022] PUT /identity/v3/projects/24be71f6204d462f906aec1afe1dcf53/users/64d53c8fcbc14f99a15eb117fc74377d/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:54:42.881582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056943-dedf-4284-99e9-68381d81c3bf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:42.881881 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056943-dedf-4284-99e9-68381d81c3bf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:42.882158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44056943-dedf-4284-99e9-68381d81c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:42.908030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-44056943-dedf-4284-99e9-68381d81c3bf None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:42.909368 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-44056943-dedf-4284-99e9-68381d81c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:42.970296 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1275/2562] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:42.979886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:42.982495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:42.992810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:43.045309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892395b-fd3a-47aa-9b2f-bd7e3f1a128f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:43.048941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:43.049591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:43.049878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:43.050156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:43.059408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:43.060841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:43.070456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1288/2563] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:47.033653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.034108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.034407 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.066661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.068632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] MFA Rules not processed for user `64d53c8fcbc14f99a15eb117fc74377d`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:47.069850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:47.076676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ee5ff1-1e27-48c7-9b90-0281394f9b94 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.079892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:47.080563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.081379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.081706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.082012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.084009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:47.097698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.099309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.113319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1289/2564] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:54:47.147838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1276/2565] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:47.152424 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.191080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5105d2-5208-48a3-bb5a-56aa7622c5e9 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.203009 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.203854 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.204138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.204416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.205109 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.207050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.241364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1290/2566] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:54:47 2022] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:54:47.245429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.258971 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787948d2-5ee7-4553-a644-ef8ed55b584c None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.329446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.330133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.330443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.330715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.331455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.333437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.360199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1277/2567] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:54:47 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:54:47.364091 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.375418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f174759-4f93-42f0-9b93-9f29964beed3 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.380661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.381449 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.381804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.382147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.382948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.384670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.397189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1291/2568] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:47.401447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.412484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2518eb6-429a-4d54-a493-5408183828b5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.417387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.418483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.418636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.418786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] PATH_INFO: `/v3/projects/fa69a6e76aa74b9abc37d053c72fb26a/users/af72a84e8cad4cd88f4060e30c63defa/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.436744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa69a6e76aa74b9abc37d053c72fb26a, user_id=af72a84e8cad4cd88f4060e30c63defa, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.439530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.458169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1278/2569] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:54:47 2022] PUT /identity/v3/projects/fa69a6e76aa74b9abc37d053c72fb26a/users/af72a84e8cad4cd88f4060e30c63defa/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:47.462602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.475943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317578b6-a708-4f98-9621-7f32706382ac admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.542404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.543276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.543676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.544694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.545440 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.547139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.557939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1292/2570] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:47.563109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:47.574085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab143-4118-40cf-a7b8-00b5a82532bb admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:47.579163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:47.580220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:47.580476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:47.580682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] PATH_INFO: `/v3/projects/fa69a6e76aa74b9abc37d053c72fb26a/users/af72a84e8cad4cd88f4060e30c63defa/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:47.584746 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa69a6e76aa74b9abc37d053c72fb26a, user_id=af72a84e8cad4cd88f4060e30c63defa, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:47.587722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:47.601294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1279/2571] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:54:47 2022] PUT /identity/v3/projects/fa69a6e76aa74b9abc37d053c72fb26a/users/af72a84e8cad4cd88f4060e30c63defa/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:51.797316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:51.802028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:51.899174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:51.907043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d31ef-3a47-41a2-a1bc-72e3120f4dc9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:51.932900 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:51.934970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:52.018490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:52.019174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:52.020129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:52.021256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:52.024582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:52.045163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:52.047129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:52.060280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1293/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:54:52.061094 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb4978f-d8b6-424d-815f-5784b0972d97 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:52.080931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:52.082200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:52.082879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:52.083524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] PATH_INFO: `/v3/users/29bed120fba74e638d9e9fe1f6d37d46` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:52.085843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bed120fba74e638d9e9fe1f6d37d46)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:52.089106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:52.097982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:52.204175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bed120fba74e638d9e9fe1f6d37d46'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.204481 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bed120fba74e638d9e9fe1f6d37d46'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.224000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bed120fba74e638d9e9fe1f6d37d46'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.230747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bed120fba74e638d9e9fe1f6d37d46'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.273008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-5178b46c-26fb-494e-b037-30ab3a1d307a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bed120fba74e638d9e9fe1f6d37d46'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.310215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1280/2573] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:54:51 2022] DELETE /identity/v3/users/29bed120fba74e638d9e9fe1f6d37d46 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:52.729259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:52.750340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3eb7b-f873-4723-8bdb-ce34e9bf08d9 service placement] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:52.874167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:52.875132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:52.875444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:52.875723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] PATH_INFO: `/v3/projects/1395db83c6574b6188bcafaca8b5fcd7` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:52.882337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1395db83c6574b6188bcafaca8b5fcd7)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:52.885318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:52.963926 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1395db83c6574b6188bcafaca8b5fcd7', 'request_id': 'req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.971473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1395db83c6574b6188bcafaca8b5fcd7', 'request_id': 'req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:52.983941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1395db83c6574b6188bcafaca8b5fcd7', 'request_id': 'req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:53.011095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] The token cache is being invalidate because project 1395db83c6574b6188bcafaca8b5fcd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:54:53.012954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:53.013537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-4c3d2d85-5b91-4c57-9bf5-f4dd8d847ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:54:53.015466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1294/2574] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:54:52 2022] DELETE /identity/v3/projects/1395db83c6574b6188bcafaca8b5fcd7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:54:53.022477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.023966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.027231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.053561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:53.055174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.138798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1281/2575] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:53.146881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.147302 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.147710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.170038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:53.171905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.195227 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1295/2576] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:54:53.200098 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.221664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8481f6-8307-4540-82f4-d9fbe3f31818 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.230940 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.232764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.233269 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.233556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.234310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:54:53.234623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.239229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.268478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1282/2577] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:54:53.269957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.281741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96fc2b-5f5e-4f4b-b09f-63684eab6b0e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.291761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.292704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.294140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.294140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.295497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.298422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.317295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:53.335295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1296/2578] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:54:53 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:54:53.339097 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.362016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919db92-79bf-48e6-8b4e-0357d6728d2e admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.443446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.444057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.444341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.444619 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.445331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.447409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.472000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:53.478329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1283/2579] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:54:53 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:54:53.482519 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.493535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de73a38-fd59-4b0e-806b-d3c45510d16d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.500742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.501463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.501745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.502020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.502760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.504493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.517994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1297/2580] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:53.521762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.533569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e25802-8a37-4791-9fc9-ef6f30be881b admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.539627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80fd48-3e07-419d-90e6-38b65538891e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.540620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80fd48-3e07-419d-90e6-38b65538891e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.541138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80fd48-3e07-419d-90e6-38b65538891e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.541631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80fd48-3e07-419d-90e6-38b65538891e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.542785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80fd48-3e07-419d-90e6-38b65538891e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.545039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80fd48-3e07-419d-90e6-38b65538891e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.563345 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1284/2581] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:54:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:54:53.567457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.578418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250b984-fa6d-426d-933e-4d51f5d1f410 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.584144 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89529fef-110d-47bb-adef-45bb8e3e2b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.585193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529fef-110d-47bb-adef-45bb8e3e2b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.585494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529fef-110d-47bb-adef-45bb8e3e2b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.585756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89529fef-110d-47bb-adef-45bb8e3e2b87 admin admin] PATH_INFO: `/v3/projects/d9899e9c1f884f358dd108e34983f1c2/users/4337897fd8e040198e7d7440e553d866/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.604452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529fef-110d-47bb-adef-45bb8e3e2b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9899e9c1f884f358dd108e34983f1c2, user_id=4337897fd8e040198e7d7440e553d866, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.607986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89529fef-110d-47bb-adef-45bb8e3e2b87 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.625420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1298/2582] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:54:53 2022] PUT /identity/v3/projects/d9899e9c1f884f358dd108e34983f1c2/users/4337897fd8e040198e7d7440e553d866/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:54:53.627274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.627599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.630042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.633778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.634070 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.634352 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.655747 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:53.657068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.674687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] MFA Rules not processed for user `af72a84e8cad4cd88f4060e30c63defa`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:53.676718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.736994 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1299/2583] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:53.747334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.748682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.764115 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1285/2584] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:53.776582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:53.778023 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.821122 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ded63-0f85-4ac0-83c9-bf888c827892 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.826850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516c0b7-9cba-47d6-9118-5164c5f923e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.827549 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c0b7-9cba-47d6-9118-5164c5f923e8 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.827835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c0b7-9cba-47d6-9118-5164c5f923e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.828115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c0b7-9cba-47d6-9118-5164c5f923e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.840324 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516c0b7-9cba-47d6-9118-5164c5f923e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.841882 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516c0b7-9cba-47d6-9118-5164c5f923e8 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.851566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033ccc-573f-4d10-b1fc-4ae3b52c9e89 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:53.852393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1300/2585] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:54:53.859181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:53.859884 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:53.860173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:53.860455 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:53.862263 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:53.924087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:53.925864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:53.936869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1286/2586] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:54:54.051133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fa1d-6699-405f-87c1-ca560d3745e7 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:54.051629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fa1d-6699-405f-87c1-ca560d3745e7 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:54.051760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984fa1d-6699-405f-87c1-ca560d3745e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:54.070557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-7984fa1d-6699-405f-87c1-ca560d3745e7 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:54.072176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7984fa1d-6699-405f-87c1-ca560d3745e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:54.131941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1301/2587] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:54:54.145873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:54:54.148498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:54:54.183909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=100 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:54.251674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f59c372-8e06-4ea3-a763-f4601deda7f3 service glance] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:54:54.259830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:54:54.260558 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:54.261404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:54.261404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:54.290653 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:54:54.292584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:54:54.306800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1287/2588] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:54:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:54:59.912425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff3117-e99d-4e84-8690-0625a53563fb None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:54:59.913396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff3117-e99d-4e84-8690-0625a53563fb None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:54:59.913687 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff3117-e99d-4e84-8690-0625a53563fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:54:59.939511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:54:59.967373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e6ff3117-e99d-4e84-8690-0625a53563fb None None] MFA Rules not processed for user `4337897fd8e040198e7d7440e553d866`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:54:59.974937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e6ff3117-e99d-4e84-8690-0625a53563fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:00.079777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1302/2589] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:00.093825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:00.095281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:00.230159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad62143-d0aa-4bba-9611-2ee40930d028 service swift] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:00.252996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574bed3-7198-4f65-bfd7-ac0ddeb2e97d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:00.260053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bed3-7198-4f65-bfd7-ac0ddeb2e97d service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:00.260968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bed3-7198-4f65-bfd7-ac0ddeb2e97d service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:00.261465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574bed3-7198-4f65-bfd7-ac0ddeb2e97d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:00.276764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bed3-7198-4f65-bfd7-ac0ddeb2e97d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:00.278854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574bed3-7198-4f65-bfd7-ac0ddeb2e97d service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:00.295048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1288/2590] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:02.445174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a119bc-0b09-4201-ae15-23c7bfadf470 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:02.445174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a119bc-0b09-4201-ae15-23c7bfadf470 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:02.445174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a119bc-0b09-4201-ae15-23c7bfadf470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:02.461015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-65a119bc-0b09-4201-ae15-23c7bfadf470 None None] MFA Rules not processed for user `4337897fd8e040198e7d7440e553d866`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:02.462498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-65a119bc-0b09-4201-ae15-23c7bfadf470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:02.473159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1303/2591] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:07.411671 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:07.412229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:07.412229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:07.430467 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] MFA Rules not processed for user `64d53c8fcbc14f99a15eb117fc74377d`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:07.431704 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:07.443800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1289/2592] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:10.766241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a612-4025-4803-be99-3e0718726994 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:10.766765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a612-4025-4803-be99-3e0718726994 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:10.766864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c47a612-4025-4803-be99-3e0718726994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:10.785059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-8c47a612-4025-4803-be99-3e0718726994 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:10.786288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8c47a612-4025-4803-be99-3e0718726994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:10.795033 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1304/2593] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 13:55:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:10.812377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:10.827363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4b875-bf88-4a04-a890-c6ad95bd062a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:10.833240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:10.834037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:10.834537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:10.834909 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:10.845472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:10.847356 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:10.856479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1290/2594] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:55:20.779636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=35 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:20.853017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=62 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:23.422312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a612-4025-4803-be99-3e0718726994 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:23.453212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c47a612-4025-4803-be99-3e0718726994 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:23.458737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:23.459433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:23.459723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:23.460050 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:23.462666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:23.475959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:23.478491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:23.495537 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1305/2595] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:33.486073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=6 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:35.430019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:35.433554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:35.570969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d64057-a0d1-4308-ad15-21624935ba59 service swift] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:35.576443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:35.577109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:35.577388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:35.577658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:35.579858 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:35.593283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:35.594904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:35.607051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1291/2596] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:39.410500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:39.419874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f7917-2bbd-44e6-8135-477f946fac7f service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:39.423456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:39.424093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:39.424376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:39.424654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:39.433943 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:39.435392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:39.444640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1306/2597] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:39.774956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:39.776763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:39.792073 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22af89f-f5f1-4465-8b9f-048dbf559946 service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:39.796180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:39.796853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:39.797148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:39.797423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:39.799207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:39.812657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:39.814175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:39.824331 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1292/2598] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:43.380815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:43.382779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:43.399435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67dae9-1efc-4333-bf3f-d454b79123ce service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:43.406709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:43.407707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:43.408005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:43.408289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] PATH_INFO: `/v3/users/2d912686df5d42a58f7369bd5d2b9d25` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:43.409491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d912686df5d42a58f7369bd5d2b9d25)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:43.411452 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:43.462018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d912686df5d42a58f7369bd5d2b9d25'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.473935 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d912686df5d42a58f7369bd5d2b9d25'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.482491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d912686df5d42a58f7369bd5d2b9d25'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.489868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d912686df5d42a58f7369bd5d2b9d25'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.490361 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-8aa910a4-9cc8-4746-90ca-ececc631ce85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d912686df5d42a58f7369bd5d2b9d25'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.510881 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1307/2599] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:55:43 2022] DELETE /identity/v3/users/2d912686df5d42a58f7369bd5d2b9d25 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:43.788936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:43.817830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff08d7b-ebd2-4904-9122-8937ee2d953a service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:43.882602 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:43.883495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:43.884009 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:43.884446 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] PATH_INFO: `/v3/projects/5f2799c8ae91495dbb779ae2305adcc4` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:43.885651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2799c8ae91495dbb779ae2305adcc4)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:43.887824 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:43.948587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2799c8ae91495dbb779ae2305adcc4', 'request_id': 'req-c574818f-6792-4b24-8207-3adbd6ae37be'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.956526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2799c8ae91495dbb779ae2305adcc4', 'request_id': 'req-c574818f-6792-4b24-8207-3adbd6ae37be'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.965122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2799c8ae91495dbb779ae2305adcc4', 'request_id': 'req-c574818f-6792-4b24-8207-3adbd6ae37be'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.979843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] The token cache is being invalidate because project 5f2799c8ae91495dbb779ae2305adcc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:55:43.980134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.981567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-c574818f-6792-4b24-8207-3adbd6ae37be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:43.983305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1293/2600] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:55:43 2022] DELETE /identity/v3/projects/5f2799c8ae91495dbb779ae2305adcc4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:43.988778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:43.989076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:43.989374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.008397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:44.009912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:44.088464 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1308/2601] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:44.091057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.091414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.092403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.106493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:44.114488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:44.116429 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:44.129838 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1294/2602] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:44.130461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.146244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c1e78-bc1f-4ac1-a54f-0afc4cfdca5e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.153353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.154039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.154392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.154759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.156609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:55:44.157111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.158934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.174589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1309/2603] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:55:44.178778 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.189106 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a65c6-d3bf-47d7-9358-79f4d3c67dd7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.194101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.195140 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.195629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.196047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.196894 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.199919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.239497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1295/2604] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:55:44 2022] POST /identity/v3/projects => generated 401 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:55:44.241442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.255461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4b867-6314-4f99-81c9-459605205c22 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.322654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:44.338275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.338959 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.339259 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.340178 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.340874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.342810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.363515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1310/2605] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:55:44 2022] POST /identity/v3/users => generated 301 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:55:44.367741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.379576 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb0000-3cbb-48af-b750-d522b3614a49 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.385326 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.386006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.386293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.387192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.388028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.389587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.400962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1296/2606] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:44.404997 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.415159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf45c2-70cf-4517-997c-d42b12045976 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.419975 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316965a-38ad-42fb-8762-05d4c0558abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.420634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316965a-38ad-42fb-8762-05d4c0558abc admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.420927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316965a-38ad-42fb-8762-05d4c0558abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.421207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316965a-38ad-42fb-8762-05d4c0558abc admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.421968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316965a-38ad-42fb-8762-05d4c0558abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.423640 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316965a-38ad-42fb-8762-05d4c0558abc admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.434180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1311/2607] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:44.438101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.447949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaaedd3-5301-4e77-9445-143708b827c8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.453256 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.454134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.454415 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.454688 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] PATH_INFO: `/v3/projects/d01695f017844cd69f87ecea51de4d06/users/4635463f6c0b4f5a92ed6a9f0a38f5d5/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.469479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d01695f017844cd69f87ecea51de4d06, user_id=4635463f6c0b4f5a92ed6a9f0a38f5d5, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.472157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.484398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1297/2608] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:55:44 2022] PUT /identity/v3/projects/d01695f017844cd69f87ecea51de4d06/users/4635463f6c0b4f5a92ed6a9f0a38f5d5/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:44.494319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.494723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.495015 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.522823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] MFA Rules not processed for user `4635463f6c0b4f5a92ed6a9f0a38f5d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:44.524072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:44.587041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1312/2609] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:44.591631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.658246 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc908a78-ec01-43d5-9283-f663087f3d33 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.662843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.663534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.663817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.664092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.664789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.666696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.692750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1298/2610] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:55:44 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:55:44.696909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.707911 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68d281-b733-465a-9222-7172eee42ac1 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.762886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.763642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.764249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.764769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.765463 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.767398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.786329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1313/2611] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:55:44 2022] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:55:44.790137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.800960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a48d3-ee9c-409f-a7d9-d1d344816ac7 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.805831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.806482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.806762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.807033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.807805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.810067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.820587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1299/2612] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:44.824863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.834565 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675e05f-6292-4b62-a9e5-4af9470d8824 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.839422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.840268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.840566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.840825 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] PATH_INFO: `/v3/projects/717de50c95364749a8cf9019532cde21/users/b2e0c0a5ea6c4c8790c673cc17d8c222/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.854934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=717de50c95364749a8cf9019532cde21, user_id=b2e0c0a5ea6c4c8790c673cc17d8c222, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.858732 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.871654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1314/2613] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:55:44 2022] PUT /identity/v3/projects/717de50c95364749a8cf9019532cde21/users/b2e0c0a5ea6c4c8790c673cc17d8c222/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:44.875435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.885243 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f458d0-f58d-4a48-8908-bb13e75cddbf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.941053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49aedd-fa97-4051-890a-7a62fa229160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.941719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49aedd-fa97-4051-890a-7a62fa229160 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.942000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49aedd-fa97-4051-890a-7a62fa229160 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.942273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49aedd-fa97-4051-890a-7a62fa229160 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.942991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49aedd-fa97-4051-890a-7a62fa229160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.944624 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49aedd-fa97-4051-890a-7a62fa229160 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.954130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1300/2614] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:44.958920 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:44.969228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53505d0a-1246-4399-a78d-0285c776aa6c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:44.973634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:44.974502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:44.974782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:44.975055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] PATH_INFO: `/v3/projects/717de50c95364749a8cf9019532cde21/users/b2e0c0a5ea6c4c8790c673cc17d8c222/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:44.981756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=717de50c95364749a8cf9019532cde21, user_id=b2e0c0a5ea6c4c8790c673cc17d8c222, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:44.985218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:44.998895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1315/2615] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:55:44 2022] PUT /identity/v3/projects/717de50c95364749a8cf9019532cde21/users/b2e0c0a5ea6c4c8790c673cc17d8c222/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:45.009991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:45.010280 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:45.010555 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:45.034409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:45.037510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] MFA Rules not processed for user `b2e0c0a5ea6c4c8790c673cc17d8c222`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:45.039208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:45.106475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1301/2616] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:55:45.116927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:45.118593 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:45.128863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:45.177711 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f29b2-2aa7-465a-8c4e-ad4c01fa16bd admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:45.181317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6437b-6b94-4fde-aca7-4a673abf6da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:45.181988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6437b-6b94-4fde-aca7-4a673abf6da9 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:45.182275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6437b-6b94-4fde-aca7-4a673abf6da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:45.182554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6437b-6b94-4fde-aca7-4a673abf6da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:45.191996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6437b-6b94-4fde-aca7-4a673abf6da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:45.193421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6437b-6b94-4fde-aca7-4a673abf6da9 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:45.203381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1316/2617] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:45 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:45.343199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:45.402780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dbced-c1f2-47c2-b646-846c6224eee1 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:45.407061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:45.407954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:45.408237 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:45.408510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] PATH_INFO: `/v3/users/4635463f6c0b4f5a92ed6a9f0a38f5d5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:45.409681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4635463f6c0b4f5a92ed6a9f0a38f5d5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:45.411604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:45.455779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4635463f6c0b4f5a92ed6a9f0a38f5d5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:45.456411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4635463f6c0b4f5a92ed6a9f0a38f5d5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:45.463286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4635463f6c0b4f5a92ed6a9f0a38f5d5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:45.464001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4635463f6c0b4f5a92ed6a9f0a38f5d5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:45.475897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4635463f6c0b4f5a92ed6a9f0a38f5d5'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:45.488854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1302/2618] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:55:45 2022] DELETE /identity/v3/users/4635463f6c0b4f5a92ed6a9f0a38f5d5 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:45.493319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:45.493801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:45.493897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:45.510812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:45.512570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:45.568871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1317/2619] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:45.578895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:45.580333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:45.601052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:45.638973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b761658-fd4b-4422-bec9-43c69ee030cf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:45.642581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:45.643215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:45.643526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:45.643798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:45.653399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:45.654775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:45.664391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1303/2620] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:45.926156 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:45.927753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:45.942733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899ef7-95fc-41e7-8a06-8581bb42b69d None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:45.947509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:45.948308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:45.948651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:45.948919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] PATH_INFO: `/v3/projects/d01695f017844cd69f87ecea51de4d06` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:45.950643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d01695f017844cd69f87ecea51de4d06)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:45.952542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:45.999176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd01695f017844cd69f87ecea51de4d06', 'request_id': 'req-c115f9f5-099a-432e-b7e6-c23eb728b87e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.005663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd01695f017844cd69f87ecea51de4d06', 'request_id': 'req-c115f9f5-099a-432e-b7e6-c23eb728b87e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.013255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd01695f017844cd69f87ecea51de4d06', 'request_id': 'req-c115f9f5-099a-432e-b7e6-c23eb728b87e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.023420 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] The token cache is being invalidate because project d01695f017844cd69f87ecea51de4d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:55:46.023709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.024327 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.025867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1318/2621] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:55:45 2022] DELETE /identity/v3/projects/d01695f017844cd69f87ecea51de4d06 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:46.029974 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.039459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4842-2e5c-43fe-a426-e18d1fb01cea service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.094554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.095443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.095726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.095999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] PATH_INFO: `/v3/users/b2e0c0a5ea6c4c8790c673cc17d8c222` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.097177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e0c0a5ea6c4c8790c673cc17d8c222)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.099088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.144564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e0c0a5ea6c4c8790c673cc17d8c222'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.145203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e0c0a5ea6c4c8790c673cc17d8c222'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.151936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e0c0a5ea6c4c8790c673cc17d8c222'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.152560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e0c0a5ea6c4c8790c673cc17d8c222'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.164438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d2b97f4b-0b16-4812-8cdc-201202c947df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e0c0a5ea6c4c8790c673cc17d8c222'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.176966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1304/2622] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:55:46 2022] DELETE /identity/v3/users/b2e0c0a5ea6c4c8790c673cc17d8c222 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:46.448481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.449919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:46.463495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115f9f5-099a-432e-b7e6-c23eb728b87e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.494341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:46.522318 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.523169 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.523616 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.523897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] PATH_INFO: `/v3/projects/717de50c95364749a8cf9019532cde21` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.525059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=717de50c95364749a8cf9019532cde21)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.526972 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.572051 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717de50c95364749a8cf9019532cde21', 'request_id': 'req-27263812-e294-4524-b6d2-fa15d5d38aec'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.577946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717de50c95364749a8cf9019532cde21', 'request_id': 'req-27263812-e294-4524-b6d2-fa15d5d38aec'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.586425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717de50c95364749a8cf9019532cde21', 'request_id': 'req-27263812-e294-4524-b6d2-fa15d5d38aec'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.596991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] The token cache is being invalidate because project 717de50c95364749a8cf9019532cde21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:55:46.597278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.597907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-27263812-e294-4524-b6d2-fa15d5d38aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:55:46.599494 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1319/2623] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:55:46 2022] DELETE /identity/v3/projects/717de50c95364749a8cf9019532cde21 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:46.605573 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.605861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.606135 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.624470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:46.625660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:46.657618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:46.684114 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1305/2624] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:46.691733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.691971 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.692252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.710301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:46.711803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:46.720093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1320/2625] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:46.724235 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.734437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc99d08-6adb-488c-aeb5-56893b7e58dc None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.738955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.739636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.739920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.740196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.740917 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:55:46.741223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.742804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.754053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1306/2626] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:55:46.758176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.767263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0223ad-de22-4016-88f7-10d486f1de50 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.771888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.772533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.772816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.773092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.773782 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.775878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.801639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1321/2627] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:55:46 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:55:46.805812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.815840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bca93-1dcd-410d-87f7-e4df73b984f0 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.871200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.871888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.872171 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.872445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.873119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.875034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.894123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1307/2628] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:55:46 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:55:46.898311 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.908996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cd6e4c-c562-4485-8f86-c880467f2854 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.913547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.914195 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.914478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.914777 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.915515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.917094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.927906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1322/2629] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:46.931684 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.941447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a093b7c-34fc-439d-a3fc-23e17e48ba61 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.945998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb2f44-f396-4951-bbfb-ba76ad44c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.946584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb2f44-f396-4951-bbfb-ba76ad44c3bb admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.946864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb2f44-f396-4951-bbfb-ba76ad44c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.947138 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb2f44-f396-4951-bbfb-ba76ad44c3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.947893 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb2f44-f396-4951-bbfb-ba76ad44c3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.949487 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb2f44-f396-4951-bbfb-ba76ad44c3bb admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:46.959033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1308/2630] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:46.963081 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:46.973560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549f983-47a8-4c25-a65e-f9344eb1ab18 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:46.978057 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:46.978925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:46.979206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:46.979525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] PATH_INFO: `/v3/projects/df60d7245d66492db0ca9b2a9f077dbb/users/641ee508fda24ad0afa27a9cb3f16f7d/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:46.994347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df60d7245d66492db0ca9b2a9f077dbb, user_id=641ee508fda24ad0afa27a9cb3f16f7d, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:46.997086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.009961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1323/2631] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:55:46 2022] PUT /identity/v3/projects/df60d7245d66492db0ca9b2a9f077dbb/users/641ee508fda24ad0afa27a9cb3f16f7d/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:47.020697 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.020988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.021266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.048772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] MFA Rules not processed for user `641ee508fda24ad0afa27a9cb3f16f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:47.049997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:47.114369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1309/2632] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:47.118951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.181087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471363f-1578-4b76-8a3d-4d9665634231 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.186419 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.187079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.187395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.187677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.188368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.190275 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.193446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:47.216847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1324/2633] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:55:47 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:55:47.220883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.232101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c59d23-8874-4980-9633-8f11b9d0c00b None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.264542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:55:47.289043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.289713 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.289999 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.290274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.290967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.293433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.312682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1310/2634] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:55:47 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:55:47.316670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.326755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b3620-b092-4379-b24e-62bf5d81b170 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.331431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.332082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.332367 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.332644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.333370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.334961 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.345827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1325/2635] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:47.349839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.360292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae039047-d562-483b-a8d7-f7a880d074e8 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.364906 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.365801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.366086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.366364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] PATH_INFO: `/v3/projects/4f1f0166d46a480b929aa80a5061bbd8/users/4a4d585bf5ac4ed4997c7f9a81d944f0/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.381320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1f0166d46a480b929aa80a5061bbd8, user_id=4a4d585bf5ac4ed4997c7f9a81d944f0, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.384000 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.396648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1311/2636] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:55:47 2022] PUT /identity/v3/projects/4f1f0166d46a480b929aa80a5061bbd8/users/4a4d585bf5ac4ed4997c7f9a81d944f0/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:47.400469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.410823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3aed41-3f58-4550-bd00-4a9a2ef389ca admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.467236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b647ee9-84ae-42a1-b309-1609fd269a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.467984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b647ee9-84ae-42a1-b309-1609fd269a6f admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.468206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b647ee9-84ae-42a1-b309-1609fd269a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.468485 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b647ee9-84ae-42a1-b309-1609fd269a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.469203 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b647ee9-84ae-42a1-b309-1609fd269a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.470791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b647ee9-84ae-42a1-b309-1609fd269a6f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.481150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1326/2637] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:55:47.485252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.495257 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fb3a8-e206-4a77-b3c9-a69ecd479a2c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.500452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.501346 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.501631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.501904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] PATH_INFO: `/v3/projects/4f1f0166d46a480b929aa80a5061bbd8/users/4a4d585bf5ac4ed4997c7f9a81d944f0/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.503876 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1f0166d46a480b929aa80a5061bbd8, user_id=4a4d585bf5ac4ed4997c7f9a81d944f0, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.506475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.516460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1312/2638] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:55:47 2022] PUT /identity/v3/projects/4f1f0166d46a480b929aa80a5061bbd8/users/4a4d585bf5ac4ed4997c7f9a81d944f0/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:55:47.527826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.528317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.528413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.554071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] MFA Rules not processed for user `4a4d585bf5ac4ed4997c7f9a81d944f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:55:47.555257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:47.622248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1327/2639] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:55:47.632965 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:47.634663 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:55:47.690919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb6bb1-761e-4650-9b89-4c561e42ef82 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:47.694559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:47.695191 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:47.695526 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:47.695804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:47.749767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:47.751116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:47.759814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1313/2640] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:50.289208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:55:50.299480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1645d4-e277-4830-88c9-41693071c578 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:55:50.302984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa7053-42b2-4664-9b6b-781e6570a9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:55:50.303682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa7053-42b2-4664-9b6b-781e6570a9ca service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:55:50.303964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa7053-42b2-4664-9b6b-781e6570a9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:55:50.304241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa7053-42b2-4664-9b6b-781e6570a9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:55:50.314397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa7053-42b2-4664-9b6b-781e6570a9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:55:50.315895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa7053-42b2-4664-9b6b-781e6570a9ca service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:55:50.325529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1328/2641] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:55:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:55:57.755837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:00.321223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:02.672124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:02.733739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5ac27-9f93-4044-842b-33dcb245dadb service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:02.738198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:02.739065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:02.739377 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:02.739659 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] PATH_INFO: `/v3/users/641ee508fda24ad0afa27a9cb3f16f7d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:02.740832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641ee508fda24ad0afa27a9cb3f16f7d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:02.742735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:02.787738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641ee508fda24ad0afa27a9cb3f16f7d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:02.788465 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641ee508fda24ad0afa27a9cb3f16f7d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:02.795388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641ee508fda24ad0afa27a9cb3f16f7d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:02.796015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641ee508fda24ad0afa27a9cb3f16f7d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:02.807593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641ee508fda24ad0afa27a9cb3f16f7d'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:02.820229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1314/2642] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:02 2022] DELETE /identity/v3/users/641ee508fda24ad0afa27a9cb3f16f7d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:02.824904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:02.825370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:02.825503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:02.844438 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:02.845642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:02.902967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1329/2643] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:02.913155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:02.914575 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:02.971049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b18f-0aed-4d1b-ad9a-d391624e6ae6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:02.974742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:02.975421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:02.975709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:02.975986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:02.984994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:02.986416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:02.995801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1315/2644] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 13:56:03.265802 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:03.267338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:03.281808 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b927d7-6e46-4fcf-b986-7013e19c3992 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:03.287536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:03.288678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:03.289104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:03.289406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] PATH_INFO: `/v3/projects/df60d7245d66492db0ca9b2a9f077dbb` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:03.290591 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df60d7245d66492db0ca9b2a9f077dbb)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:03.292556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:03.339405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df60d7245d66492db0ca9b2a9f077dbb', 'request_id': 'req-995fbe4a-ffed-4a7e-a13e-8769e314eee1'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.346788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df60d7245d66492db0ca9b2a9f077dbb', 'request_id': 'req-995fbe4a-ffed-4a7e-a13e-8769e314eee1'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.356665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df60d7245d66492db0ca9b2a9f077dbb', 'request_id': 'req-995fbe4a-ffed-4a7e-a13e-8769e314eee1'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.367383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] The token cache is being invalidate because project df60d7245d66492db0ca9b2a9f077dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:03.367675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.368307 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.369858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1330/2645] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:03 2022] DELETE /identity/v3/projects/df60d7245d66492db0ca9b2a9f077dbb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:03.374543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:03.384378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23147ff7-2ff0-46f7-932d-e92552dc9186 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:03.403109 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:03.443980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:03.444776 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:03.445055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:03.445330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] PATH_INFO: `/v3/users/4a4d585bf5ac4ed4997c7f9a81d944f0` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:03.446522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4d585bf5ac4ed4997c7f9a81d944f0)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:03.448474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:03.494832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4d585bf5ac4ed4997c7f9a81d944f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.495567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4d585bf5ac4ed4997c7f9a81d944f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.503112 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4d585bf5ac4ed4997c7f9a81d944f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.503809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4d585bf5ac4ed4997c7f9a81d944f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.515609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-535478fb-ad48-41d3-b751-fda1f11524b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4d585bf5ac4ed4997c7f9a81d944f0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.527644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1316/2646] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:03 2022] DELETE /identity/v3/users/4a4d585bf5ac4ed4997c7f9a81d944f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:03.790929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:03.792444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:03.806611 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fbe4a-ffed-4a7e-a13e-8769e314eee1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:03.864434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:03.865299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:03.865583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:03.865858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] PATH_INFO: `/v3/projects/4f1f0166d46a480b929aa80a5061bbd8` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:03.867029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1f0166d46a480b929aa80a5061bbd8)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:03.868988 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:03.897685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:03.915386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1f0166d46a480b929aa80a5061bbd8', 'request_id': 'req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.921928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1f0166d46a480b929aa80a5061bbd8', 'request_id': 'req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.929090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1f0166d46a480b929aa80a5061bbd8', 'request_id': 'req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.939779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] The token cache is being invalidate because project 4f1f0166d46a480b929aa80a5061bbd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:03.940068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.940695 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c99dc7a4-fc62-49c2-866c-c50aebc5f52a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:03.942276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1331/2647] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:03 2022] DELETE /identity/v3/projects/4f1f0166d46a480b929aa80a5061bbd8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:03.947127 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:03.947626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:03.947728 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:03.967444 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:03.968583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:04.025822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1317/2648] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:04.033798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.034094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.034379 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.052944 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:04.054172 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:04.062236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1332/2649] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:04.066292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.075948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1949c1b-9c30-49aa-92f6-cc590b810947 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.080386 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.081025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.081306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.081597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.082319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:56:04.082620 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.084234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.096188 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1318/2650] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 13:56:04.100376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.110014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae52f8-5d9d-4cba-a86c-3dc50be89358 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.114563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.115205 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.115515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.115790 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.116475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.118357 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.142381 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1333/2651] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/projects => generated 389 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:04.146478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.156656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e5936-0f15-4da8-bb5b-d2790c774e4c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.181789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:04.213798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.214462 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.214747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.215024 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.215815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.218330 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.239063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1319/2652] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:04.243198 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.253397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2422299-0e39-411d-8a0e-0357b1788597 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.257909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.258557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.258841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.259116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.259874 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.261495 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.272090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1334/2653] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:04.275830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.286252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114e304-bddb-493a-ae27-727b44dc7a1d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.290786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a85edb-9b2e-40e1-bb38-e1ee68cc29e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.291474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a85edb-9b2e-40e1-bb38-e1ee68cc29e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.291759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a85edb-9b2e-40e1-bb38-e1ee68cc29e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.292031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a85edb-9b2e-40e1-bb38-e1ee68cc29e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.292746 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a85edb-9b2e-40e1-bb38-e1ee68cc29e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.294307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a85edb-9b2e-40e1-bb38-e1ee68cc29e3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.303861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1320/2654] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:04.307761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.317601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce26d0b-2a9f-44b6-b9fa-b782008942ca admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.322271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.323165 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.323490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.323794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] PATH_INFO: `/v3/projects/8c6a557e2e7744cb82c398dcfbc6406a/users/2200c7407f974d3687a309093655548e/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.338830 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6a557e2e7744cb82c398dcfbc6406a, user_id=2200c7407f974d3687a309093655548e, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.342139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.354727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1335/2655] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:04 2022] PUT /identity/v3/projects/8c6a557e2e7744cb82c398dcfbc6406a/users/2200c7407f974d3687a309093655548e/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:04.365725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.366021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.366302 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.392726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] MFA Rules not processed for user `2200c7407f974d3687a309093655548e`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:04.393986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:04.456656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1321/2656] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:04.461309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.521141 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b16c6-c557-4207-923b-7fb3bf1fbc45 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.525723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.526374 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.526663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.526948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.527682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.530197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.554187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1336/2657] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:04.558186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.568809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a22aa-7a92-416d-bcf0-b3d393ef557f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.626141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.626798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.627084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.627387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.628080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.630011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.650095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1322/2658] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:04.654147 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.664278 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160c6c6-4cd5-4883-8897-fe999fb10b97 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.668774 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.669422 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.669707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.669981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.670696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.672297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.682726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1337/2659] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:04.687203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.697285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320637e-2bb9-4139-9f62-4744cdd4f69c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.702707 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.703621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.703905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.704179 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] PATH_INFO: `/v3/projects/6651314cd2204b15aa497043563b88d3/users/5c9781fd61b34f158a9e60eab3f619de/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.719372 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6651314cd2204b15aa497043563b88d3, user_id=5c9781fd61b34f158a9e60eab3f619de, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.722007 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.735213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1323/2660] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:04 2022] PUT /identity/v3/projects/6651314cd2204b15aa497043563b88d3/users/5c9781fd61b34f158a9e60eab3f619de/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:04.739038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.748753 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523b86-fe5d-4e90-8461-505d90e0710c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.768014 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:04.806953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd53f088-79bb-4376-b40b-5867f0894b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.807659 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f088-79bb-4376-b40b-5867f0894b4b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.807951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f088-79bb-4376-b40b-5867f0894b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.808231 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53f088-79bb-4376-b40b-5867f0894b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.808980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53f088-79bb-4376-b40b-5867f0894b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.810613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd53f088-79bb-4376-b40b-5867f0894b4b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.820483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1338/2661] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:04.824529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.829951 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:04.836229 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbd795-4975-40ca-ba50-b33a3d6afc8c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:04.841772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:04.842647 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.842931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.843205 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] PATH_INFO: `/v3/projects/6651314cd2204b15aa497043563b88d3/users/5c9781fd61b34f158a9e60eab3f619de/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.845416 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6651314cd2204b15aa497043563b88d3, user_id=5c9781fd61b34f158a9e60eab3f619de, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:04.848071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:04.858756 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1324/2662] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:04 2022] PUT /identity/v3/projects/6651314cd2204b15aa497043563b88d3/users/5c9781fd61b34f158a9e60eab3f619de/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:04.868979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:04.869470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:04.869572 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:04.895429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] MFA Rules not processed for user `5c9781fd61b34f158a9e60eab3f619de`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:04.896639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:04.963678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1339/2663] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:04.974318 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:04.976046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:05.032621 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b630-11ed-430e-81b8-9f89c475e2f2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:05.036292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fc401-1aa3-498c-aeb6-731719b274b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:05.036931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc401-1aa3-498c-aeb6-731719b274b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:05.037216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc401-1aa3-498c-aeb6-731719b274b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:05.037491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fc401-1aa3-498c-aeb6-731719b274b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:05.047096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fc401-1aa3-498c-aeb6-731719b274b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:05.048634 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fc401-1aa3-498c-aeb6-731719b274b9 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:05.058677 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1325/2664] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:05.183938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:05.244442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3e18f-8b7a-4909-9b17-5c1728e471dd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:05.249471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:05.250338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:05.250618 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:05.250891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] PATH_INFO: `/v3/users/2200c7407f974d3687a309093655548e` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:05.252087 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2200c7407f974d3687a309093655548e)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:05.253998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:05.298055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2200c7407f974d3687a309093655548e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.299186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:05.312743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2200c7407f974d3687a309093655548e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.319436 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2200c7407f974d3687a309093655548e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.320096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2200c7407f974d3687a309093655548e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.320708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2200c7407f974d3687a309093655548e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.333255 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1340/2665] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:05 2022] DELETE /identity/v3/users/2200c7407f974d3687a309093655548e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:05.337997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:05.338286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:05.338589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:05.356556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:05.358323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:05.413982 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1326/2666] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:05.423980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:05.425405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:05.483368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ff1b3-7bdb-44d9-8d13-af4944167451 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:05.486952 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:05.487651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:05.487937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:05.488213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:05.497300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:05.498731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:05.508181 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1341/2667] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:05.771479 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:05.772959 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:05.788141 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a9d6-c9d5-4539-b33a-a51e194fa338 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:05.790842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:05.791905 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:05.792183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:05.792451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] PATH_INFO: `/v3/projects/8c6a557e2e7744cb82c398dcfbc6406a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:05.793649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6a557e2e7744cb82c398dcfbc6406a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:05.795696 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:05.853485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6a557e2e7744cb82c398dcfbc6406a', 'request_id': 'req-b5f53777-2f33-467b-b154-8c78e7f0cc92'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.859011 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6a557e2e7744cb82c398dcfbc6406a', 'request_id': 'req-b5f53777-2f33-467b-b154-8c78e7f0cc92'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.865156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6a557e2e7744cb82c398dcfbc6406a', 'request_id': 'req-b5f53777-2f33-467b-b154-8c78e7f0cc92'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.877113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] The token cache is being invalidate because project 8c6a557e2e7744cb82c398dcfbc6406a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:05.877397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.878019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:05.879725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1327/2668] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:05 2022] DELETE /identity/v3/projects/8c6a557e2e7744cb82c398dcfbc6406a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:05.883836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:05.893752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f963-0c64-41e8-ab80-b2a9c6e3f8bc service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:05.948353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:05.949224 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:05.949511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:05.949793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] PATH_INFO: `/v3/users/5c9781fd61b34f158a9e60eab3f619de` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:05.951571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9781fd61b34f158a9e60eab3f619de)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:05.953577 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:05.998300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9781fd61b34f158a9e60eab3f619de'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.009953 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9781fd61b34f158a9e60eab3f619de'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.014998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:06.018343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9781fd61b34f158a9e60eab3f619de'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.019236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9781fd61b34f158a9e60eab3f619de'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.020150 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-0db1309d-2c41-4d28-9e17-d86d80908ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9781fd61b34f158a9e60eab3f619de'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.034233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1342/2669] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:05 2022] DELETE /identity/v3/users/5c9781fd61b34f158a9e60eab3f619de => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:06.296623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.298803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:06.312896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53777-2f33-467b-b154-8c78e7f0cc92 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.325181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:06.372102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.373485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.373767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.374042 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] PATH_INFO: `/v3/projects/6651314cd2204b15aa497043563b88d3` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.375250 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6651314cd2204b15aa497043563b88d3)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.377241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.422244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6651314cd2204b15aa497043563b88d3', 'request_id': 'req-965540de-11d2-4093-8061-022f5e219c70'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.427581 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6651314cd2204b15aa497043563b88d3', 'request_id': 'req-965540de-11d2-4093-8061-022f5e219c70'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.433529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6651314cd2204b15aa497043563b88d3', 'request_id': 'req-965540de-11d2-4093-8061-022f5e219c70'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.446655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] The token cache is being invalidate because project 6651314cd2204b15aa497043563b88d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:06.446928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.447585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-965540de-11d2-4093-8061-022f5e219c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:06.449169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1328/2670] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:06 2022] DELETE /identity/v3/projects/6651314cd2204b15aa497043563b88d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:06.454804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.455096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.455413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.473497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:06.474698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:06.532299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1343/2671] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:06.539886 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.540176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.540451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.558772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:06.560582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:06.568595 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1329/2672] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:06.572589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.582119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aafffc-b03b-4593-b652-0e59aaad34d8 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.586940 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.587629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.587915 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.588191 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.588912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:56:06.589220 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.590811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.602412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1344/2673] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:56:06.607288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.616485 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b10c-c3c3-4af2-8c2c-5bfe620df361 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.621101 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.621745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.622031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.622309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.623615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.625505 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.649436 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1330/2674] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:06 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:06.653323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.663263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bb842-99a5-4e66-8f87-f47cd8855343 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.718654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.719336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.719631 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.719909 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.720596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.722493 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.744252 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1345/2675] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:06 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:06.748868 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.759734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c250e-4c4d-4004-9a31-d3178f1ce764 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.764473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.765315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.765648 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.765929 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.766667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.768329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.782398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1331/2676] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:56:06.784074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.799587 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e4ff1-0c4d-44b0-baac-a2629e3aed32 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.804288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a0a2c-1cff-43d4-b498-b5678a1a1e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.804951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a0a2c-1cff-43d4-b498-b5678a1a1e0e admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.805239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a0a2c-1cff-43d4-b498-b5678a1a1e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.805517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a0a2c-1cff-43d4-b498-b5678a1a1e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.806236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a0a2c-1cff-43d4-b498-b5678a1a1e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.807910 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a0a2c-1cff-43d4-b498-b5678a1a1e0e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.818696 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1346/2677] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:06.822947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:06.833570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be539705-fc35-4fec-9838-84bef545bc8d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:06.838514 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:06.839456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.839763 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.840021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] PATH_INFO: `/v3/projects/da4f4972cab94c0dbe05e05402c1e59b/users/9d107f18870043d2bed02277ec118d81/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.862895 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da4f4972cab94c0dbe05e05402c1e59b, user_id=9d107f18870043d2bed02277ec118d81, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:06.865955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:06.881076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1332/2678] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:06 2022] PUT /identity/v3/projects/da4f4972cab94c0dbe05e05402c1e59b/users/9d107f18870043d2bed02277ec118d81/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:06.892454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:06.892989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:06.892989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:06.922288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] MFA Rules not processed for user `9d107f18870043d2bed02277ec118d81`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:06.923514 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:06.965902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:06.995681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1347/2679] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:07.000152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.047276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:07.066156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ebc9e-158e-4138-8d98-4b17ffcfe34f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.070829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.071516 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.071800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.072074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.072774 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.074667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.101336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1333/2680] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:06 2022] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:07.105807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.118457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3757823-4843-4cf5-83d9-64681637e5b6 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.184097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.184964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.185353 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.185735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.186551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.188622 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.209193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1348/2681] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:07 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:07.213578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.225286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb7cd4-d87f-4502-81e1-366f46b378fe admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.230113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.230786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.231084 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.231447 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.232255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.233860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.244670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1334/2682] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:07.249386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.259707 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad0dd8-0afa-4a19-826c-01f1301b78c5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.264890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.265773 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.266106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.266383 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] PATH_INFO: `/v3/projects/4152642a545c4b689e45d725fdaba161/users/c42a97a1a5324c3b97a413b110720f9b/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.282055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4152642a545c4b689e45d725fdaba161, user_id=c42a97a1a5324c3b97a413b110720f9b, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.284770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.298547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1349/2683] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:07 2022] PUT /identity/v3/projects/4152642a545c4b689e45d725fdaba161/users/c42a97a1a5324c3b97a413b110720f9b/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:07.302796 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.312930 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3faa7-9b4c-40e8-a082-f7a2ec0bd07c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.369794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88177c49-1813-4942-8e0e-b554322570ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.370476 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88177c49-1813-4942-8e0e-b554322570ae admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.370765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88177c49-1813-4942-8e0e-b554322570ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.371045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88177c49-1813-4942-8e0e-b554322570ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.371826 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88177c49-1813-4942-8e0e-b554322570ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.373484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88177c49-1813-4942-8e0e-b554322570ae admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.383123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1335/2684] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:07.387691 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.398716 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685bba5b-b30d-4c14-90f7-acaa4d5cdef7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.403414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.404912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.405199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.405477 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] PATH_INFO: `/v3/projects/4152642a545c4b689e45d725fdaba161/users/c42a97a1a5324c3b97a413b110720f9b/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.407491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4152642a545c4b689e45d725fdaba161, user_id=c42a97a1a5324c3b97a413b110720f9b, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.410134 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.420498 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1350/2685] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:07 2022] PUT /identity/v3/projects/4152642a545c4b689e45d725fdaba161/users/c42a97a1a5324c3b97a413b110720f9b/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:07.430818 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.431062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.431375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.457394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] MFA Rules not processed for user `c42a97a1a5324c3b97a413b110720f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:07.458609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:07.526165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1336/2686] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:07 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:07.538554 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.540317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:07.597912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4d643-4a6f-4ca5-8a1e-a488dff887e0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.601492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.602239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.602538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.602860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.612408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.613871 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.623724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1351/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:07 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:07.699198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:07.709468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae78626c-2083-4656-82e9-9471faba6621 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:07.713376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc375acd-0457-43b5-b10d-6347558a9e6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:07.714016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375acd-0457-43b5-b10d-6347558a9e6f service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:07.714305 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375acd-0457-43b5-b10d-6347558a9e6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:07.714582 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc375acd-0457-43b5-b10d-6347558a9e6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:07.746877 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:07.772458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc375acd-0457-43b5-b10d-6347558a9e6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:07.773921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc375acd-0457-43b5-b10d-6347558a9e6f service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:07.782726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1337/2688] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:12.391368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:12.431867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:12.454533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13f170-6bb2-4a18-a97d-7e1402381367 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:12.459084 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:12.459985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:12.460518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:12.460799 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] PATH_INFO: `/v3/users/9d107f18870043d2bed02277ec118d81` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:12.461983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d107f18870043d2bed02277ec118d81)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:12.463979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:12.509823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d107f18870043d2bed02277ec118d81'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:12.521382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d107f18870043d2bed02277ec118d81'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:12.528094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d107f18870043d2bed02277ec118d81'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:12.528749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d107f18870043d2bed02277ec118d81'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:12.529346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d107f18870043d2bed02277ec118d81'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:12.541653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1352/2689] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:12 2022] DELETE /identity/v3/users/9d107f18870043d2bed02277ec118d81 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:12.546652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:12.547110 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:12.547221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:12.564711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:12.565915 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:12.624839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1338/2690] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:12.634312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:12.635764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:12.692073 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2958b52-930b-4a7b-9531-adcd21c74e6f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:12.695698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:12.696340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:12.696625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:12.696907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:12.705919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:12.707392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:12.716962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1353/2691] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:12.984920 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:12.986440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:13.000211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8aaaf-5adf-4e9f-a4b3-f07550b4c506 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:13.004904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:13.005766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.006045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.006315 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] PATH_INFO: `/v3/projects/da4f4972cab94c0dbe05e05402c1e59b` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.007599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da4f4972cab94c0dbe05e05402c1e59b)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:13.009565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:13.055359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da4f4972cab94c0dbe05e05402c1e59b', 'request_id': 'req-e6b99548-7e93-4c5a-846e-99875d611427'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.060835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da4f4972cab94c0dbe05e05402c1e59b', 'request_id': 'req-e6b99548-7e93-4c5a-846e-99875d611427'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.066719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da4f4972cab94c0dbe05e05402c1e59b', 'request_id': 'req-e6b99548-7e93-4c5a-846e-99875d611427'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.077892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] The token cache is being invalidate because project da4f4972cab94c0dbe05e05402c1e59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:13.078183 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.078800 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.080365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1339/2692] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:12 2022] DELETE /identity/v3/projects/da4f4972cab94c0dbe05e05402c1e59b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:13.084385 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:13.094693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ac2f-863b-4069-8b7f-3f7720835fb9 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:13.149343 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:13.150214 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.150500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.150780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] PATH_INFO: `/v3/users/c42a97a1a5324c3b97a413b110720f9b` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.151962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42a97a1a5324c3b97a413b110720f9b)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:13.154414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:13.155889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:13.203393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42a97a1a5324c3b97a413b110720f9b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.216838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42a97a1a5324c3b97a413b110720f9b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.223824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42a97a1a5324c3b97a413b110720f9b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.224475 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42a97a1a5324c3b97a413b110720f9b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.225078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-f7972da3-73b9-4a31-a8ef-5e6dc09f7fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42a97a1a5324c3b97a413b110720f9b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.237529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1354/2693] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:13 2022] DELETE /identity/v3/users/c42a97a1a5324c3b97a413b110720f9b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:13.510908 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:13.512374 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:13.525887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b99548-7e93-4c5a-846e-99875d611427 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:13.585208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:13.586712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.587165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.587649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] PATH_INFO: `/v3/projects/4152642a545c4b689e45d725fdaba161` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.589363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4152642a545c4b689e45d725fdaba161)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:13.593061 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:13.595145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:13.651742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4152642a545c4b689e45d725fdaba161', 'request_id': 'req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.657861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4152642a545c4b689e45d725fdaba161', 'request_id': 'req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.664018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4152642a545c4b689e45d725fdaba161', 'request_id': 'req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.676627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] The token cache is being invalidate because project 4152642a545c4b689e45d725fdaba161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:13.676913 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.677544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6ab9dd4-0c8e-4d60-857a-bbcf121a6b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:13.679089 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1340/2694] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:13 2022] DELETE /identity/v3/projects/4152642a545c4b689e45d725fdaba161 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:13.684152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.684682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.684682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.703303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:13.704517 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:13.761801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1355/2695] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:13.770973 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.771267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.771628 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.792164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:13.793402 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:13.801588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1341/2696] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:56:13.806161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:13.815757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78568dd-5b6b-47c6-b2aa-bbb882be5f84 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:13.820294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:13.820945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.821228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.821505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.822256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:56:13.822563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:13.824197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:13.836491 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1356/2697] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:56:13.840534 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:13.850335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1928e-1374-4c26-95de-939f61c0cf90 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:13.854897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:13.855569 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.855852 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.856126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.856817 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:13.858705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:13.883850 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1342/2698] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:13 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 13:56:13.888470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:13.898281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290bd9a-7192-4b29-b89f-42f7041c57a5 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:13.954852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:13.955581 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:13.955870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:13.956167 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:13.956857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:13.958794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:13.969211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:13.981516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1357/2699] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:13 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:13.985708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:13.995978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f8f4-464d-4e53-b296-09b0193aa828 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.001139 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.001790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.002079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.002358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.003086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.004701 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.015799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1343/2700] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:14.019702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:14.029643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754c279-5c02-43d1-803b-84f423b6d292 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.034414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8735b5-5fae-4c8e-bc03-578b29fd64ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.035056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8735b5-5fae-4c8e-bc03-578b29fd64ad admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.035369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8735b5-5fae-4c8e-bc03-578b29fd64ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.035678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8735b5-5fae-4c8e-bc03-578b29fd64ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.036397 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8735b5-5fae-4c8e-bc03-578b29fd64ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.038037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8735b5-5fae-4c8e-bc03-578b29fd64ad admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.048627 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1358/2701] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:14.052773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:14.063391 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee855230-5ddc-4dbb-865f-6c2b175c0c0a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.068153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.069030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.069316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.069598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] PATH_INFO: `/v3/projects/3531a2b719694b4b843924a8a9dea2a5/users/47635c179e7245beb7f3848e2ea4f805/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.084539 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3531a2b719694b4b843924a8a9dea2a5, user_id=47635c179e7245beb7f3848e2ea4f805, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.087586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.099816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1344/2702] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:14 2022] PUT /identity/v3/projects/3531a2b719694b4b843924a8a9dea2a5/users/47635c179e7245beb7f3848e2ea4f805/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:14.109877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.110166 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.110442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.136118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] MFA Rules not processed for user `47635c179e7245beb7f3848e2ea4f805`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:14.137300 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:14.198950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1359/2703] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:14.210721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:14.212456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:14.281249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2d2b4d-b674-4dbe-825c-604bc1ce7e5c admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.285430 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6b19e3-a193-4a3d-93dd-49b903c87d78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.286087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b19e3-a193-4a3d-93dd-49b903c87d78 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.286375 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b19e3-a193-4a3d-93dd-49b903c87d78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.286656 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6b19e3-a193-4a3d-93dd-49b903c87d78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.295404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b19e3-a193-4a3d-93dd-49b903c87d78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.296843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6b19e3-a193-4a3d-93dd-49b903c87d78 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.308722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1345/2704] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:14.328301 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:14.389779 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74990d1-5c9c-4467-a6f8-46fe752a09a4 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.394235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.395099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.395403 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.395685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] PATH_INFO: `/v3/users/47635c179e7245beb7f3848e2ea4f805` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.396850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47635c179e7245beb7f3848e2ea4f805)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.398780 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.444851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47635c179e7245beb7f3848e2ea4f805'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:14.456788 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47635c179e7245beb7f3848e2ea4f805'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:14.463826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47635c179e7245beb7f3848e2ea4f805'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:14.464488 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47635c179e7245beb7f3848e2ea4f805'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:14.465107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47635c179e7245beb7f3848e2ea4f805'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:14.467628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:14.479442 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1360/2705] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:14 2022] DELETE /identity/v3/users/47635c179e7245beb7f3848e2ea4f805 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:14.484692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.484987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.485267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.503298 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:14.504513 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:14.527793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:14.564398 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1346/2706] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:14.574024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:14.575489 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:14.633934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a7b73-8fe6-440b-a678-947f937b3428 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.637680 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0b2a7e-bdce-4abe-807e-ce7cc39992f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.638334 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b2a7e-bdce-4abe-807e-ce7cc39992f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.638623 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b2a7e-bdce-4abe-807e-ce7cc39992f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.638902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0b2a7e-bdce-4abe-807e-ce7cc39992f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.648012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b2a7e-bdce-4abe-807e-ce7cc39992f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.649386 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0b2a7e-bdce-4abe-807e-ce7cc39992f8 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.658859 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1361/2707] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:14.926715 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:14.928208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:14.940570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2c5a0-dbd9-47e7-9eab-fa98e0d902d3 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:14.945337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:14.946202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:14.946533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:14.946815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] PATH_INFO: `/v3/projects/3531a2b719694b4b843924a8a9dea2a5` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:14.948323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3531a2b719694b4b843924a8a9dea2a5)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:14.950220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:14.997025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3531a2b719694b4b843924a8a9dea2a5', 'request_id': 'req-714f1397-03e0-44bb-9cf7-2250bfd4b39c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.002577 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3531a2b719694b4b843924a8a9dea2a5', 'request_id': 'req-714f1397-03e0-44bb-9cf7-2250bfd4b39c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.008563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3531a2b719694b4b843924a8a9dea2a5', 'request_id': 'req-714f1397-03e0-44bb-9cf7-2250bfd4b39c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.020827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] The token cache is being invalidate because project 3531a2b719694b4b843924a8a9dea2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:15.021108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.021717 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-714f1397-03e0-44bb-9cf7-2250bfd4b39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.023249 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1347/2708] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:14 2022] DELETE /identity/v3/projects/3531a2b719694b4b843924a8a9dea2a5 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:15.028171 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.029216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.029314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.047540 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:15.048745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:15.108873 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1362/2709] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:15.116493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.116786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.117064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.134784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:15.135997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:15.144234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1348/2710] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:15.148149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.158049 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274921e-533a-4451-bff5-272d5c84b38e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.162675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.163346 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.163634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.163912 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.164670 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:56:15.164979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.166601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.182029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1363/2711] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:56:15.186028 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.195240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948fd28-392f-4a30-981b-5cb1baf3cad0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.200830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.201517 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.201794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.202067 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.202770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.204692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.230283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1349/2712] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:15 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:15.234232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.246217 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d3fc1-ddc7-45ae-81cb-1b040d153909 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.302065 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.302736 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.303024 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.303304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.304058 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.305970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.324929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1364/2713] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:15 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:15.329670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.340254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128b95b-03c2-4cf1-b282-be6e30a24db4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.345618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.346274 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.346557 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.346832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.347586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.349227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.359385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1350/2714] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:15.363196 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.372886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553a4f9-115f-485f-ab95-b9825452e0a9 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.377330 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd75550-4ead-4823-98cb-c50fa52f8c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.377970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75550-4ead-4823-98cb-c50fa52f8c08 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.378256 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75550-4ead-4823-98cb-c50fa52f8c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.378533 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd75550-4ead-4823-98cb-c50fa52f8c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.379251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd75550-4ead-4823-98cb-c50fa52f8c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.380872 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd75550-4ead-4823-98cb-c50fa52f8c08 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.391225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1365/2715] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:15.395038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.405443 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cdf1d-263c-4ad6-8175-fc8e063d58f4 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.410001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.410864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.411148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.411460 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] PATH_INFO: `/v3/projects/a11e2cefb6374e50be64662dcc9c81aa/users/8c001b94e94343738c8a276e981bedfd/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.425739 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11e2cefb6374e50be64662dcc9c81aa, user_id=8c001b94e94343738c8a276e981bedfd, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.428437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.440769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1351/2716] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:15 2022] PUT /identity/v3/projects/a11e2cefb6374e50be64662dcc9c81aa/users/8c001b94e94343738c8a276e981bedfd/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:15.505552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.505828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.506159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.512028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:15.534506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] MFA Rules not processed for user `8c001b94e94343738c8a276e981bedfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:15.535737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:15.598120 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1366/2717] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:56:15.609658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.611379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:15.663116 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:15.666980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c03067-fc74-4421-9e7a-3c7ca36b057f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.672568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc855f-e59c-4300-9612-a4e6ebe3b018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.673437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc855f-e59c-4300-9612-a4e6ebe3b018 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.673769 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc855f-e59c-4300-9612-a4e6ebe3b018 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.674438 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc855f-e59c-4300-9612-a4e6ebe3b018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.683766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc855f-e59c-4300-9612-a4e6ebe3b018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.685794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc855f-e59c-4300-9612-a4e6ebe3b018 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.695434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1352/2718] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:15.715421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.782518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5b7cf-ea3b-47d5-9bd3-8feb41c5fc45 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:15.787947 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:15.788918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.789665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.789665 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] PATH_INFO: `/v3/users/8c001b94e94343738c8a276e981bedfd` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.790908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c001b94e94343738c8a276e981bedfd)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:15.792886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:15.839225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c001b94e94343738c8a276e981bedfd'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.851929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c001b94e94343738c8a276e981bedfd'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.859391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c001b94e94343738c8a276e981bedfd'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.860216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c001b94e94343738c8a276e981bedfd'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.860823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c001b94e94343738c8a276e981bedfd'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:15.873632 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1367/2719] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:15 2022] DELETE /identity/v3/users/8c001b94e94343738c8a276e981bedfd => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:15.878081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:15.878379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:15.878660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:15.896043 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:15.897242 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:15.953464 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1353/2720] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:15.963066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:15.964483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:15.978032 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:16.024508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67083bb8-8728-4e1a-918b-357cc1bccdba admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.028143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31e584-1283-4a94-959a-c945cb2166d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.028784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e584-1283-4a94-959a-c945cb2166d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.029326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e584-1283-4a94-959a-c945cb2166d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.029326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31e584-1283-4a94-959a-c945cb2166d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.038230 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31e584-1283-4a94-959a-c945cb2166d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.039697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b31e584-1283-4a94-959a-c945cb2166d2 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.049486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1368/2721] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:16.316017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.317433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:16.329844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6f120-01bc-41ba-899b-6e7231a55b29 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.335015 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.336349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.336632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.336910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] PATH_INFO: `/v3/projects/a11e2cefb6374e50be64662dcc9c81aa` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.338793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11e2cefb6374e50be64662dcc9c81aa)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.340765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.386934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11e2cefb6374e50be64662dcc9c81aa', 'request_id': 'req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:16.393085 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11e2cefb6374e50be64662dcc9c81aa', 'request_id': 'req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:16.399240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11e2cefb6374e50be64662dcc9c81aa', 'request_id': 'req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:16.410914 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] The token cache is being invalidate because project a11e2cefb6374e50be64662dcc9c81aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:16.411203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:16.411853 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-d4b1b98d-5525-4c2b-8f7c-033acef59c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:16.413378 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1354/2722] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:16 2022] DELETE /identity/v3/projects/a11e2cefb6374e50be64662dcc9c81aa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:16.418264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.418553 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.418832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.437460 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:16.438649 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:16.495957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1369/2723] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:16.504556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.504851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.505134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.523618 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:16.524828 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:16.532875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1355/2724] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:16.536908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.546481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabc596-1826-4fa4-9eda-0484d370d576 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.551008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.551693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.551987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.552271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] PATH_INFO: `/v3/domains` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.552999 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 13:56:16.553313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.554927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.567119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1370/2725] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 13:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 13:56:16.571277 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.581122 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e162a5-c945-4215-9c28-db0adb5e6798 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.585960 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.586615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.587553 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.587837 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] PATH_INFO: `/v3/projects` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.588529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.590420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.616556 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1356/2726] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 13:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:16.620752 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.631393 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca58a4-c5a5-42ff-bfa9-3b765d025996 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.687506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.688170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.688453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.688754 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] PATH_INFO: `/v3/users` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.689434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.691372 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.713846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1371/2727] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 13:56:16 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 13:56:16.714942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.725086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85872f42-36a9-41e2-96d0-369530a44d07 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.729786 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.730441 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.730729 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.731006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.732293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.733892 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.744126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1357/2728] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 13:56:16.748526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.758148 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d86a98-0106-4c77-bb11-444e320fbde1 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.762645 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b25aa9-b92e-443a-93c4-ed19f0bcfd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.763283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b25aa9-b92e-443a-93c4-ed19f0bcfd04 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.763601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b25aa9-b92e-443a-93c4-ed19f0bcfd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.763878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b25aa9-b92e-443a-93c4-ed19f0bcfd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.764590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b25aa9-b92e-443a-93c4-ed19f0bcfd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.766152 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b25aa9-b92e-443a-93c4-ed19f0bcfd04 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.775826 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1372/2729] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 13:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 13:56:16.779629 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.789540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0d6fb-a143-47e4-802b-3a06e3b26a8f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:16.794699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:16.795611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.795897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.796174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] PATH_INFO: `/v3/projects/b85c8d85a5be4675b902a012e15a313d/users/489ecacde4244e0691a0ab4b901f23c3/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.812162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85c8d85a5be4675b902a012e15a313d, user_id=489ecacde4244e0691a0ab4b901f23c3, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:16.814861 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:16.827567 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1358/2730] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 13:56:16 2022] PUT /identity/v3/projects/b85c8d85a5be4675b902a012e15a313d/users/489ecacde4244e0691a0ab4b901f23c3/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:16.838025 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:16.838319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:16.838598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:16.864683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] MFA Rules not processed for user `489ecacde4244e0691a0ab4b901f23c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:16.865875 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:16.874376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:16.931500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1373/2731] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:16.943292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:16.944977 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:16.958560 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:17.003499 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18dfa8-11c4-44f4-8987-73530d6c20b6 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:17.006976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9aea7-2513-4ab0-b0c5-a184def8375d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:17.007650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9aea7-2513-4ab0-b0c5-a184def8375d service glance] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:17.007939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9aea7-2513-4ab0-b0c5-a184def8375d service glance] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:17.008217 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9aea7-2513-4ab0-b0c5-a184def8375d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:17.016670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9aea7-2513-4ab0-b0c5-a184def8375d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:17.018095 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec9aea7-2513-4ab0-b0c5-a184def8375d service glance] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:17.026923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1359/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:26.928453 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=23 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:27.022948 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=21 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:36.600810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:36.662078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1905c349-8b68-4dfe-b359-a06ad2ffe0dd None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:36.666644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:36.667546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:36.667833 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:36.668107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] PATH_INFO: `/v3/users/489ecacde4244e0691a0ab4b901f23c3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:36.669271 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=489ecacde4244e0691a0ab4b901f23c3)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:36.671216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:36.717360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '489ecacde4244e0691a0ab4b901f23c3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:36.729478 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '489ecacde4244e0691a0ab4b901f23c3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:36.736207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '489ecacde4244e0691a0ab4b901f23c3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:36.736856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '489ecacde4244e0691a0ab4b901f23c3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:36.737454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '489ecacde4244e0691a0ab4b901f23c3'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:36.749724 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1374/2733] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:56:36 2022] DELETE /identity/v3/users/489ecacde4244e0691a0ab4b901f23c3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:56:36.754223 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:36.754721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:36.754814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:36.773271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:36.774473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:36.833014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1360/2734] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:56:36.843003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:36.844454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:36.900316 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e50334-1507-4e8a-ad1b-ea98208ff6f6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:36.903855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a242980-5d20-465f-b8f3-94865d0252de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:36.904487 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242980-5d20-465f-b8f3-94865d0252de service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:36.904768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242980-5d20-465f-b8f3-94865d0252de service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:36.905042 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a242980-5d20-465f-b8f3-94865d0252de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:36.914408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242980-5d20-465f-b8f3-94865d0252de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:36.915858 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a242980-5d20-465f-b8f3-94865d0252de service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:36.925039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1375/2735] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:56:37.188150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:37.190176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:37.203779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb30f11-a2d4-490a-93e6-a6d3e94e1300 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:37.209537 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:37.210705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:37.210986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:37.211258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] PATH_INFO: `/v3/projects/b85c8d85a5be4675b902a012e15a313d` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:37.212510 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85c8d85a5be4675b902a012e15a313d)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:37.214418 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:37.260745 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85c8d85a5be4675b902a012e15a313d', 'request_id': 'req-8d55ef65-6e80-4904-bed9-ce4ee01349a3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:37.266232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85c8d85a5be4675b902a012e15a313d', 'request_id': 'req-8d55ef65-6e80-4904-bed9-ce4ee01349a3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:37.273137 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85c8d85a5be4675b902a012e15a313d', 'request_id': 'req-8d55ef65-6e80-4904-bed9-ce4ee01349a3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:37.286019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] The token cache is being invalidate because project b85c8d85a5be4675b902a012e15a313d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:56:37.286312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:37.286927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:56:37.288488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1361/2736] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:56:37 2022] DELETE /identity/v3/projects/b85c8d85a5be4675b902a012e15a313d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:56:46.129835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:46.130366 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:46.130469 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:46.147595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] MFA Rules not processed for user `4337897fd8e040198e7d7440e553d866`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:56:46.148791 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:46.164767 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:46.208265 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1376/2737] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:56:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:56:47.282987 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:56.201454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=15 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:56:58.777314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:56:58.778923 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:58.843825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55ef65-6e80-4904-bed9-ce4ee01349a3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:56:58.847686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:56:58.848347 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:56:58.849278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:56:58.849599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:56:58.851626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:56:58.932527 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:56:58.933993 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:56:58.945635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1362/2738] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:56:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:57:00.182400 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:57:00.191979 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde7565-1b80-4c60-8b04-7cbe5e751950 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:57:00.195516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:57:00.196149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:57:00.196430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:57:00.196701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:57:00.198431 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:57:00.211730 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:57:00.213149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:57:00.224441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1377/2739] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:57:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:57:08.941078 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=54 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:57:10.219135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=6 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:08.081835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:08.091286 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa6108-f008-4d1b-b198-151658f6a6d4 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:08.094875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:08.095543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:08.095830 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:08.096113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:08.097874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:08.107180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:08.108627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970fe36-4a82-4621-b16a-887292ee97a6 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:08.116524 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1363/2740] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:58:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:58:16.329675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:16.331238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:16.347892 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bc3e1-41c0-487d-a952-e66ef5294ddd service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:16.355443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:16.356428 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:16.357069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:16.358003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:16.360297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:16.374001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:16.375757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:16.389615 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1378/2741] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:58:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:58:18.112979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:26.383942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=6 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:26.621050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75eed-ef22-4043-9562-5849729cf286 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:26.621522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75eed-ef22-4043-9562-5849729cf286 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:26.621627 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc75eed-ef22-4043-9562-5849729cf286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:26.639683 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-3fc75eed-ef22-4043-9562-5849729cf286 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:58:26.640904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3fc75eed-ef22-4043-9562-5849729cf286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:26.695469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1364/2742] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 13:58:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:58:26.736843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:26.738269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:26.807663 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46a1c3-e163-4fdd-902b-83d64c825860 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:26.812819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:26.813481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:26.813768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:26.814048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:26.822699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:26.824542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:26.834107 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1379/2743] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 13:58:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 13:58:28.882053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:28.882639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:28.882639 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:28.901535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] MFA Rules not processed for user `4337897fd8e040198e7d7440e553d866`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:58:28.903018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:28.911630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1365/2744] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:58:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 13:58:29.239037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:29.249371 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3b98-67af-4a3e-b538-81d1f8ce74db service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:29.253135 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:29.254008 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:29.254294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:29.254628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:29.256755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:29.269642 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:29.271654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:29.282376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1380/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:58:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:58:29.632456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:29.634593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:29.732413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce922d9-0350-488f-aacc-4d459277904f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:29.738018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:29.738794 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:29.739080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:29.739393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:29.741231 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:29.753642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:29.755288 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:29.766251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1366/2746] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:58:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:58:33.844356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:33.845831 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:33.910289 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d7c11-1fa1-4c46-9c52-966f1de5236b service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:33.914776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:33.915677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:33.915965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:33.916243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] PATH_INFO: `/v3/users/64d53c8fcbc14f99a15eb117fc74377d` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:33.917461 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d53c8fcbc14f99a15eb117fc74377d)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:33.919434 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:33.966064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d53c8fcbc14f99a15eb117fc74377d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:33.977869 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d53c8fcbc14f99a15eb117fc74377d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:33.984742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d53c8fcbc14f99a15eb117fc74377d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:33.985459 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d53c8fcbc14f99a15eb117fc74377d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:33.986082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d53c8fcbc14f99a15eb117fc74377d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:33.990034 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:34.000511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1381/2747] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:58:33 2022] DELETE /identity/v3/users/64d53c8fcbc14f99a15eb117fc74377d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 13:58:34.173617 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:34.184954 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f18bb-f00c-49f5-afd4-924c20a48386 service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:34.250301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:34.251134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:34.251440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:34.251714 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] PATH_INFO: `/v3/projects/24be71f6204d462f906aec1afe1dcf53` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:34.254475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24be71f6204d462f906aec1afe1dcf53)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:34.259175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:34.293815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:34.308045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24be71f6204d462f906aec1afe1dcf53', 'request_id': 'req-9ffeaf2d-a809-44e9-b772-1f734e4bd549'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.314072 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24be71f6204d462f906aec1afe1dcf53', 'request_id': 'req-9ffeaf2d-a809-44e9-b772-1f734e4bd549'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.320544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24be71f6204d462f906aec1afe1dcf53', 'request_id': 'req-9ffeaf2d-a809-44e9-b772-1f734e4bd549'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.338074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] The token cache is being invalidate because project 24be71f6204d462f906aec1afe1dcf53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:58:34.338355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.338992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.340854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1367/2748] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:58:34 2022] DELETE /identity/v3/projects/24be71f6204d462f906aec1afe1dcf53 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:58:34.344651 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:34.346392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:34.361223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d358555-3620-456b-be35-47d49c16527e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:34.426755 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:34.427832 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:34.427946 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:34.428168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] PATH_INFO: `/v3/users/af72a84e8cad4cd88f4060e30c63defa` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:34.429496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=af72a84e8cad4cd88f4060e30c63defa)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:34.436360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:34.486341 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af72a84e8cad4cd88f4060e30c63defa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.499836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af72a84e8cad4cd88f4060e30c63defa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.506669 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af72a84e8cad4cd88f4060e30c63defa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.507368 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af72a84e8cad4cd88f4060e30c63defa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.507978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af72a84e8cad4cd88f4060e30c63defa'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.520560 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1382/2749] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 13:58:34 2022] DELETE /identity/v3/users/af72a84e8cad4cd88f4060e30c63defa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:58:34.695329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:34.696833 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:34.715605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffeaf2d-a809-44e9-b772-1f734e4bd549 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:34.772497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:34.773303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:34.773614 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:34.773890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] PATH_INFO: `/v3/projects/fa69a6e76aa74b9abc37d053c72fb26a` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:34.775670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa69a6e76aa74b9abc37d053c72fb26a)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:34.777667 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:34.824743 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa69a6e76aa74b9abc37d053c72fb26a', 'request_id': 'req-b51a2f50-619b-42a6-abb2-2276632ce685'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.830126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa69a6e76aa74b9abc37d053c72fb26a', 'request_id': 'req-b51a2f50-619b-42a6-abb2-2276632ce685'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.836163 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa69a6e76aa74b9abc37d053c72fb26a', 'request_id': 'req-b51a2f50-619b-42a6-abb2-2276632ce685'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.848470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] The token cache is being invalidate because project fa69a6e76aa74b9abc37d053c72fb26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 13:58:34.848754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.849369 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b51a2f50-619b-42a6-abb2-2276632ce685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 13:58:34.851012 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1368/2750] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 13:58:34 2022] DELETE /identity/v3/projects/fa69a6e76aa74b9abc37d053c72fb26a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 13:58:37.508719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:58:37.510304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:37.592396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106e0a6-6838-4908-bbe3-dfe61ea1b5ff admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:58:37.601112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:37.655693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:58:37.656269 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:58:37.656556 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:58:37.656835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:58:37.658592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:58:37.671018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:58:37.672708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:58:37.683329 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1383/2751] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:58:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 13:58:44.845568 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:58:47.678880 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=28 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 13:59:56.861371 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:59:56.861903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:59:56.861903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:59:56.888970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] MFA Rules not processed for user `4337897fd8e040198e7d7440e553d866`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 13:59:56.890168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:59:56.959017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1369/2752] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 13:59:57.256303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 13:59:57.257884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:59:57.341661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46855b27-32f3-443d-a2cf-dcea1f4658c8 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 13:59:57.345624 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 13:59:57.346268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 13:59:57.346551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 13:59:57.346827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 13:59:57.348590 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 13:59:57.358568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 13:59:57.360020 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 13:59:57.367893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1384/2753] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 13:59:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:00:00.077844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:00:00.079606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:00:00.139734 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c5918-95b2-4c8f-90a1-727a051eb8c2 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:00:00.146297 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370923e0-1571-48e7-8247-af0611058470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:00:00.147887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370923e0-1571-48e7-8247-af0611058470 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:00:00.148189 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370923e0-1571-48e7-8247-af0611058470 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:00:00.148473 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370923e0-1571-48e7-8247-af0611058470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:00:00.150570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-370923e0-1571-48e7-8247-af0611058470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:00:00.162542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370923e0-1571-48e7-8247-af0611058470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:00:00.164264 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370923e0-1571-48e7-8247-af0611058470 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:00:00.175136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1370/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:00:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:00:07.364331 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=39 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:00:10.170365 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=58 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:07.358471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:07.359916 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:07.447497 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac0255-7a97-497b-a2de-3346456bd47f service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:07.452373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:07.453013 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:07.453294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:07.453571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:07.455358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:07.466939 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:07.468578 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:07.479042 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1385/2755] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:17.474744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=41 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:29.305921 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370923e0-1571-48e7-8247-af0611058470 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:29.307411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-370923e0-1571-48e7-8247-af0611058470 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:29.340802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370923e0-1571-48e7-8247-af0611058470 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:29.344681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:29.345337 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:29.345601 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:29.345874 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:29.348182 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:29.429515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:29.430947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:29.449564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1371/2756] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:32.168901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:32.181325 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3f1f-0824-4e23-b23a-16c9cab0d006 service placement] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:32.186954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:32.187650 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.187937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.188216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.190044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:32.202896 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:32.209328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:32.221756 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1386/2757] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:32.240395 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:32.241944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:32.260258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd5501-47c9-4cc3-837d-58a710a6b30c service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:32.265536 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:32.266535 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.266825 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.267102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] PATH_INFO: `/v3/users/4337897fd8e040198e7d7440e553d866` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.268495 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4337897fd8e040198e7d7440e553d866)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:32.270551 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:32.319187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4337897fd8e040198e7d7440e553d866'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.319896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4337897fd8e040198e7d7440e553d866'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.326626 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4337897fd8e040198e7d7440e553d866'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.327335 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4337897fd8e040198e7d7440e553d866'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.338979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b56a4e7b-d00d-4861-a898-0347c3627eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4337897fd8e040198e7d7440e553d866'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.352197 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1372/2758] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:01:32 2022] DELETE /identity/v3/users/4337897fd8e040198e7d7440e553d866 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:32.525763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:32.536811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b4edd-761e-43e1-9c99-48dad89edda8 service placement] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:32.591989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:32.592847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.593128 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.593404 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] PATH_INFO: `/v3/projects/d9899e9c1f884f358dd108e34983f1c2` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.594639 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9899e9c1f884f358dd108e34983f1c2)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:32.596502 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:32.641193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9899e9c1f884f358dd108e34983f1c2', 'request_id': 'req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.647701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9899e9c1f884f358dd108e34983f1c2', 'request_id': 'req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.654662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9899e9c1f884f358dd108e34983f1c2', 'request_id': 'req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.665344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] The token cache is being invalidate because project d9899e9c1f884f358dd108e34983f1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:01:32.665630 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.666245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-7b3f2eb1-15a4-4deb-b957-18deefdc2f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:32.667824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1387/2759] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:01:32 2022] DELETE /identity/v3/projects/d9899e9c1f884f358dd108e34983f1c2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:32.672738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9006-c23d-44af-9eea-12d07413845d None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.673029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9006-c23d-44af-9eea-12d07413845d None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.673306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9006-c23d-44af-9eea-12d07413845d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.694190 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:32.729840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-948f9006-c23d-44af-9eea-12d07413845d None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:32.730969 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-948f9006-c23d-44af-9eea-12d07413845d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:32.786949 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1373/2760] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:32.794541 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.794836 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.795125 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.813456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:32.814661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:32.822529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1388/2761] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:32.826793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9006-c23d-44af-9eea-12d07413845d None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:32.836785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9006-c23d-44af-9eea-12d07413845d None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:32.841509 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:32.842154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.842435 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.842709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.843474 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:01:32.843780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:32.845367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:32.857155 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1374/2762] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 14:01:32.861313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:32.870446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9810de73-ec7e-46ab-9f79-7b6e44fe2d06 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:32.875043 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:32.875729 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.876018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.876294 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.876973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:32.879396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:32.904819 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1389/2763] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:01:32 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:32.908787 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:32.918936 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8e64c-45ee-4d5f-8fb6-63cb1d11586d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:32.973091 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:32.973749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:32.974031 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:32.974312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:32.975027 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:32.976944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:32.997588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1375/2764] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:01:32 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:01:33.001598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.012399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8e058-2243-4dc5-a526-474cf2a33f0e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.017531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.018185 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.018470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.019369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.020095 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.021697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.032007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1390/2765] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:33.035829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.045819 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26495867-e85c-4fba-8939-06d9fdf245cf admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.050529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa3581-b6f9-46be-a24e-7bb0af07d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.051186 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3581-b6f9-46be-a24e-7bb0af07d972 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.051522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3581-b6f9-46be-a24e-7bb0af07d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.051804 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa3581-b6f9-46be-a24e-7bb0af07d972 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.052533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa3581-b6f9-46be-a24e-7bb0af07d972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.054118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa3581-b6f9-46be-a24e-7bb0af07d972 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.063911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1376/2766] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:33.068283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.078067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bfb2e-256a-4f54-abfd-a2c9f070c11e admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.083287 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.084183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.084467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.084798 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] PATH_INFO: `/v3/projects/cd756e3da81942a2bf1c0feee2bb39b4/users/2366339871b0470e8017e7462a5847f3/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.099962 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd756e3da81942a2bf1c0feee2bb39b4, user_id=2366339871b0470e8017e7462a5847f3, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.102706 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.114931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1391/2767] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:33 2022] PUT /identity/v3/projects/cd756e3da81942a2bf1c0feee2bb39b4/users/2366339871b0470e8017e7462a5847f3/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:33.125591 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.125890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.126174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.153928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] MFA Rules not processed for user `2366339871b0470e8017e7462a5847f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:33.155147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:33.195275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:33.218992 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1377/2768] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:33.223482 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.236512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:33.287037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500c821-2cb1-4087-bd99-c4d7d8a73087 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.291592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.292245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.292532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.292811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.293503 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.295433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.320564 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1392/2769] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:01:33 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:01:33.324598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.335074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a34b6f-8a01-4095-93e2-f1b4c33b1737 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.388843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.389497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.389798 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.390059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.390765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.392695 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.410699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1378/2770] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:01:33 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:33.414637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.424810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaf52b-5e44-4fd1-8c57-fcc2188919b3 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.429914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.430563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.430850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.431129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.431886 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.433511 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.444857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1393/2771] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:33.448780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.458456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b53f2-b769-4841-a0f0-8bd692177446 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.463048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.463964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.464251 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.464528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] PATH_INFO: `/v3/projects/c6d4afaa02bf487d9406377a5f09276f/users/90d626f6c4d349fc86b003f7f6dcc81c/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.479051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4afaa02bf487d9406377a5f09276f, user_id=90d626f6c4d349fc86b003f7f6dcc81c, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.481727 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.495241 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1379/2772] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:33 2022] PUT /identity/v3/projects/c6d4afaa02bf487d9406377a5f09276f/users/90d626f6c4d349fc86b003f7f6dcc81c/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:33.499250 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.509856 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ba01d-ff87-4e77-b43c-5aeb86d4e00b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.563907 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7aa89-b275-4165-817b-8ebd5f0871d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.564568 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7aa89-b275-4165-817b-8ebd5f0871d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.564855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7aa89-b275-4165-817b-8ebd5f0871d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.565132 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7aa89-b275-4165-817b-8ebd5f0871d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.566458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7aa89-b275-4165-817b-8ebd5f0871d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.568130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7aa89-b275-4165-817b-8ebd5f0871d5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.577666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1394/2773] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:33.581844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.592147 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23791cf1-0d4e-4fce-ae57-59f1d80790bc admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.596705 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.597593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.597873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.598145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] PATH_INFO: `/v3/projects/c6d4afaa02bf487d9406377a5f09276f/users/90d626f6c4d349fc86b003f7f6dcc81c/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.600153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d4afaa02bf487d9406377a5f09276f, user_id=90d626f6c4d349fc86b003f7f6dcc81c, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.602785 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.613133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1380/2774] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:33 2022] PUT /identity/v3/projects/c6d4afaa02bf487d9406377a5f09276f/users/90d626f6c4d349fc86b003f7f6dcc81c/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:33.622721 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.623010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.623312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.652525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] MFA Rules not processed for user `90d626f6c4d349fc86b003f7f6dcc81c`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:33.653783 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:33.720552 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1395/2775] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:33.732152 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.733890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:33.812134 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ebe49e-f6cf-48a2-b2f9-a73449ad26a2 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.815883 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.816466 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.816747 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.817022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.825816 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.827226 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.836419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1381/2776] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:33.904709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:33.914877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a67b1-dd7f-45ed-b6a7-ca68bd213e75 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:33.918396 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ed42-6137-4013-8783-8ffe33ec2ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:33.919029 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ed42-6137-4013-8783-8ffe33ec2ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:33.919309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ed42-6137-4013-8783-8ffe33ec2ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:33.919612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ed42-6137-4013-8783-8ffe33ec2ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:33.924629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:33.976682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ed42-6137-4013-8783-8ffe33ec2ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:33.978117 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ed42-6137-4013-8783-8ffe33ec2ff0 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:33.986976 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1396/2777] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:36.660772 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:36.679720 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:36.722875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c406f34-78ff-4cb8-9566-52bf1a7e53a9 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:36.727278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:36.728168 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:36.728475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:36.728744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] PATH_INFO: `/v3/users/2366339871b0470e8017e7462a5847f3` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:36.729889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2366339871b0470e8017e7462a5847f3)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:36.731832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:36.781504 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2366339871b0470e8017e7462a5847f3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:36.782255 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2366339871b0470e8017e7462a5847f3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:36.792611 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2366339871b0470e8017e7462a5847f3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:36.793340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2366339871b0470e8017e7462a5847f3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:36.813357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2366339871b0470e8017e7462a5847f3'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:36.830609 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1382/2778] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:01:36 2022] DELETE /identity/v3/users/2366339871b0470e8017e7462a5847f3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:36.834938 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:36.835439 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:36.835536 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:36.855003 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:36.856516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:36.917889 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1397/2779] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:36.928308 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:36.929808 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:36.989093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b512c-01c7-4fe5-ae66-3fddb38a1406 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:36.992841 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:36.993497 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:36.993784 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:36.994068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:37.003276 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:37.004750 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:37.014136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1383/2780] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:37.284345 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:37.286295 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:37.299242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175ccf1-df23-400f-a537-a1f6948e6c81 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:37.304241 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:37.305121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:37.305406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:37.305684 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] PATH_INFO: `/v3/projects/cd756e3da81942a2bf1c0feee2bb39b4` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:37.307060 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd756e3da81942a2bf1c0feee2bb39b4)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:37.309068 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:37.355985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd756e3da81942a2bf1c0feee2bb39b4', 'request_id': 'req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.361966 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd756e3da81942a2bf1c0feee2bb39b4', 'request_id': 'req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.368902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd756e3da81942a2bf1c0feee2bb39b4', 'request_id': 'req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.379280 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] The token cache is being invalidate because project cd756e3da81942a2bf1c0feee2bb39b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:01:37.379597 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.380216 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.381728 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1398/2781] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:01:37 2022] DELETE /identity/v3/projects/cd756e3da81942a2bf1c0feee2bb39b4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 14:01:37.385857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:37.396057 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d8f71-ffd1-4c01-ba90-019702885384 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:37.433126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:37.452888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:37.453693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:37.453972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:37.454275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] PATH_INFO: `/v3/users/90d626f6c4d349fc86b003f7f6dcc81c` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:37.455469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=90d626f6c4d349fc86b003f7f6dcc81c)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:37.457967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:37.501358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90d626f6c4d349fc86b003f7f6dcc81c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.502003 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90d626f6c4d349fc86b003f7f6dcc81c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.509314 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90d626f6c4d349fc86b003f7f6dcc81c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.509947 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90d626f6c4d349fc86b003f7f6dcc81c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.522292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-63df1ebb-3e3d-4340-98a7-d8551b468fbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90d626f6c4d349fc86b003f7f6dcc81c'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.534997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1384/2782] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:01:37 2022] DELETE /identity/v3/users/90d626f6c4d349fc86b003f7f6dcc81c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:37.796455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:37.797919 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:37.811714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9f2fd-5ad9-410e-8fcb-c03142b83f00 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:37.841717 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:37.871399 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:37.872268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:37.872558 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:37.872842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] PATH_INFO: `/v3/projects/c6d4afaa02bf487d9406377a5f09276f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:37.874016 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d4afaa02bf487d9406377a5f09276f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:37.875984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:37.921444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d4afaa02bf487d9406377a5f09276f', 'request_id': 'req-ac065d78-322b-47b0-b4ae-036bc8336718'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.927921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d4afaa02bf487d9406377a5f09276f', 'request_id': 'req-ac065d78-322b-47b0-b4ae-036bc8336718'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.934989 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d4afaa02bf487d9406377a5f09276f', 'request_id': 'req-ac065d78-322b-47b0-b4ae-036bc8336718'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.946027 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] The token cache is being invalidate because project c6d4afaa02bf487d9406377a5f09276f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:01:37.946314 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.946931 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ac065d78-322b-47b0-b4ae-036bc8336718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:37.948504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1399/2783] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:01:37 2022] DELETE /identity/v3/projects/c6d4afaa02bf487d9406377a5f09276f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:37.953410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:37.953873 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:37.953991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:37.971783 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:37.972903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:38.059779 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1385/2784] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 14:01:38.068184 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.068481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.068765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.086518 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:38.087744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:38.095763 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1400/2785] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:38.099770 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.109132 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f294b5-0354-48ae-8452-ce48f9725f82 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.114176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.114809 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.115093 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.115388 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.116107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:01:38.116427 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.117981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.130219 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1386/2786] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 14:01:38.134222 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.143364 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710afd9-e08f-4258-b961-c1c12220c8bf None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.148264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.148903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.149187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.149592 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.151288 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.152221 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.180450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1401/2787] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:38.184586 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.194604 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537378f-4a3e-4a62-a2f3-6193dc973182 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.236851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:38.251420 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.252088 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.252376 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.252657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.253350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.255254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.274055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1387/2788] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/users => generated 299 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:38.278105 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.288964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3e794-402d-4ea8-a39e-2c5393aaf720 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.293757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.294421 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.294709 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.294992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.296038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.298000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.310534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1402/2789] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:38.318964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.329364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae10c4-eb21-46e3-8973-0da300f8d4ab admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.334019 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca2f5b-01bb-47e6-b46f-41d7bd51bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.334674 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca2f5b-01bb-47e6-b46f-41d7bd51bcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.334955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca2f5b-01bb-47e6-b46f-41d7bd51bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.335228 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca2f5b-01bb-47e6-b46f-41d7bd51bcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.335984 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca2f5b-01bb-47e6-b46f-41d7bd51bcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.337585 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca2f5b-01bb-47e6-b46f-41d7bd51bcc7 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.348545 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1388/2790] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:38.352634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.363291 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5975a-ef9b-4b38-be18-4e528aef8908 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.367885 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.368757 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.369041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.369319 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] PATH_INFO: `/v3/projects/ea813dce9da8488898b97fbccb3e3b3c/users/c539e1acbf994923a3439a3cc8a36d55/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.383375 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea813dce9da8488898b97fbccb3e3b3c, user_id=c539e1acbf994923a3439a3cc8a36d55, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.386028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.398710 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1403/2791] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:38 2022] PUT /identity/v3/projects/ea813dce9da8488898b97fbccb3e3b3c/users/c539e1acbf994923a3439a3cc8a36d55/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 14:01:38.410442 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.410764 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.411050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.437523 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] MFA Rules not processed for user `c539e1acbf994923a3439a3cc8a36d55`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:38.438732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:38.501220 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1389/2792] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:38.505562 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.562251 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:38.566253 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8e907-1fd8-4c2c-b43b-c562d04e48f6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.572602 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.573267 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.573715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.574055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.574902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.576849 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.602625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1404/2793] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:38.606812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.617291 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00ad89-d31c-4bd2-a9e6-f5dcc0ff7abf None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.672390 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.673059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.673342 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.673616 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.674311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.676387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.698654 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1390/2794] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:38.700263 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.710996 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae09586-441c-41c4-a3b7-9431b49d231a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.715656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.716608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.716895 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.717176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.717899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.719532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.730506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1405/2795] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:38.734354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.744408 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842de55-a160-488c-86c9-e872807cb656 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.749018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.749890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.750176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.750452 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] PATH_INFO: `/v3/projects/96990518ab0d4f63b85a6549780954b2/users/6c9abd6c32ac43a6ba9081b4bb8dd419/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.764864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96990518ab0d4f63b85a6549780954b2, user_id=6c9abd6c32ac43a6ba9081b4bb8dd419, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.767445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.780642 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1391/2796] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:38 2022] PUT /identity/v3/projects/96990518ab0d4f63b85a6549780954b2/users/6c9abd6c32ac43a6ba9081b4bb8dd419/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:38.785055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.795085 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8569071d-9969-4afe-99c5-24642e1d43f7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.850425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a4f4f-a661-4e53-8d0c-017c7fb2e0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.851092 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a4f4f-a661-4e53-8d0c-017c7fb2e0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.851410 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a4f4f-a661-4e53-8d0c-017c7fb2e0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.851690 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a4f4f-a661-4e53-8d0c-017c7fb2e0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.852412 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a4f4f-a661-4e53-8d0c-017c7fb2e0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.854005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a4f4f-a661-4e53-8d0c-017c7fb2e0e5 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.863598 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1406/2797] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:38.867793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:38.877904 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6e449-061d-41fd-8d83-149a6cad3f63 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:38.882887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:38.883793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.884076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.884354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] PATH_INFO: `/v3/projects/96990518ab0d4f63b85a6549780954b2/users/6c9abd6c32ac43a6ba9081b4bb8dd419/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.886266 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96990518ab0d4f63b85a6549780954b2, user_id=6c9abd6c32ac43a6ba9081b4bb8dd419, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:38.888890 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:38.899379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1392/2798] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:38 2022] PUT /identity/v3/projects/96990518ab0d4f63b85a6549780954b2/users/6c9abd6c32ac43a6ba9081b4bb8dd419/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:38.909276 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:38.909573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:38.909860 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:38.935249 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] MFA Rules not processed for user `6c9abd6c32ac43a6ba9081b4bb8dd419`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:38.936468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:39.005470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1407/2799] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:39.016008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:39.017698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:39.028076 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:39.076655 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b981d9-2ebf-4a0e-bdfd-67b8ed5d9e30 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:39.080293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:39.080928 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:39.081258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:39.082046 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:39.090812 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:39.092515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:39.101792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1393/2800] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:39.170714 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:39.180206 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e2a6b-c9ac-4e9a-ab47-780ebc20e439 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:39.183761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c3da4-8ffc-4998-87c3-c816005d9d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:39.184395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3da4-8ffc-4998-87c3-c816005d9d12 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:39.184678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3da4-8ffc-4998-87c3-c816005d9d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:39.184954 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c3da4-8ffc-4998-87c3-c816005d9d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:39.232096 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:39.242030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c3da4-8ffc-4998-87c3-c816005d9d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:39.243523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c3da4-8ffc-4998-87c3-c816005d9d12 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:39.252414 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1408/2801] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:43.251942 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:43.312590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff4195-a5c7-498d-976b-3d01fcc65899 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:43.317145 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:43.318006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:43.318293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:43.318578 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] PATH_INFO: `/v3/users/c539e1acbf994923a3439a3cc8a36d55` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:43.319781 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c539e1acbf994923a3439a3cc8a36d55)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:43.321686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:43.367498 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c539e1acbf994923a3439a3cc8a36d55'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.368074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c539e1acbf994923a3439a3cc8a36d55'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.374721 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c539e1acbf994923a3439a3cc8a36d55'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.375379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c539e1acbf994923a3439a3cc8a36d55'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.387232 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c539e1acbf994923a3439a3cc8a36d55'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.399761 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1394/2802] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:01:43 2022] DELETE /identity/v3/users/c539e1acbf994923a3439a3cc8a36d55 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:43.404268 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:43.404741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:43.404866 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:43.421801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:43.422981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:43.479427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1409/2803] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:43.488754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:43.490158 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:43.522422 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:43.549001 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6026479-ec2f-4a80-a2d0-88c8182d8d75 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:43.552732 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:43.553373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:43.553661 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:43.553938 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:43.562926 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:43.564382 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:43.574733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1395/2804] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:43.841284 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:43.842980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:43.855089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8583c-ee54-4e1d-83f0-750c15e29c01 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:43.859595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:43.860468 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:43.860751 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:43.861031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] PATH_INFO: `/v3/projects/ea813dce9da8488898b97fbccb3e3b3c` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:43.862219 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea813dce9da8488898b97fbccb3e3b3c)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:43.865163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:43.911682 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea813dce9da8488898b97fbccb3e3b3c', 'request_id': 'req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.917608 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea813dce9da8488898b97fbccb3e3b3c', 'request_id': 'req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.925666 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea813dce9da8488898b97fbccb3e3b3c', 'request_id': 'req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.935797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] The token cache is being invalidate because project ea813dce9da8488898b97fbccb3e3b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:01:43.936119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.936765 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:43.938427 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1410/2805] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:01:43 2022] DELETE /identity/v3/projects/ea813dce9da8488898b97fbccb3e3b3c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:43.943208 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:43.952751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e25364-b8ce-4d36-a491-989e5838d94a service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.006911 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.007803 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.008082 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.008355 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] PATH_INFO: `/v3/users/6c9abd6c32ac43a6ba9081b4bb8dd419` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.009521 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9abd6c32ac43a6ba9081b4bb8dd419)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.011458 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.056016 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9abd6c32ac43a6ba9081b4bb8dd419'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.056666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9abd6c32ac43a6ba9081b4bb8dd419'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.063566 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9abd6c32ac43a6ba9081b4bb8dd419'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.064195 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9abd6c32ac43a6ba9081b4bb8dd419'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.076323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-921b7306-7718-471b-868d-e03a49663de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9abd6c32ac43a6ba9081b4bb8dd419'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.088541 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1396/2806] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:01:43 2022] DELETE /identity/v3/users/6c9abd6c32ac43a6ba9081b4bb8dd419 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:44.354850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.356370 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:44.369726 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e57a8d-f3ed-43ed-bf81-b5a93af94a9d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.427037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.427927 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.428208 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.428481 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] PATH_INFO: `/v3/projects/96990518ab0d4f63b85a6549780954b2` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.429648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96990518ab0d4f63b85a6549780954b2)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.431654 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.447523 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:44.478983 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96990518ab0d4f63b85a6549780954b2', 'request_id': 'req-344874f2-6d58-4811-ac30-8c882f25e718'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.484921 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96990518ab0d4f63b85a6549780954b2', 'request_id': 'req-344874f2-6d58-4811-ac30-8c882f25e718'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.492557 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96990518ab0d4f63b85a6549780954b2', 'request_id': 'req-344874f2-6d58-4811-ac30-8c882f25e718'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.502942 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] The token cache is being invalidate because project 96990518ab0d4f63b85a6549780954b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:01:44.503363 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.503998 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-344874f2-6d58-4811-ac30-8c882f25e718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:01:44.505573 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1411/2807] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:01:44 2022] DELETE /identity/v3/projects/96990518ab0d4f63b85a6549780954b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 14:01:44.510562 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.511033 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.511133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.530385 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:44.531625 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:44.574922 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:44.590768 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1397/2808] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:44.600653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.600948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.601229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.619088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:44.620349 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:44.628312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1412/2809] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:44.632636 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.642488 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d7cce-5b64-46c1-bf49-04141c708c82 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.647518 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.648198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.648477 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.648749 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.649469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:01:44.649771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.651367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.663196 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1398/2810] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 14:01:44.667344 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.676395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672545eb-a18d-4fe6-a173-e439ac6eb91b None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.681038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.681737 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.681970 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.682248 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.682929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.684867 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.710538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1413/2811] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:01:44 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:44.714563 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.725221 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f8897-b31a-44aa-beb1-84ae39d29745 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.778723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.779406 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.779712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.779991 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.780666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.782544 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.805633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1399/2812] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:01:44 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:44.807193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.817561 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f4e6d-3af2-4a7d-abe0-6b9e822972ab admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.822140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.822794 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.823079 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.823384 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.824108 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.825702 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.836525 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1414/2813] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:44.840463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.851310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054f74-d67a-4436-8f1e-361a2647c581 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.855888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f0b809-50b0-4a6c-bb25-984d1a0812b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.856543 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0b809-50b0-4a6c-bb25-984d1a0812b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.856829 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0b809-50b0-4a6c-bb25-984d1a0812b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.857107 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f0b809-50b0-4a6c-bb25-984d1a0812b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.857831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0b809-50b0-4a6c-bb25-984d1a0812b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.859450 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f0b809-50b0-4a6c-bb25-984d1a0812b9 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.869225 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1400/2814] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:44.873392 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:44.884237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af21fd-084b-4480-b8ce-ed10031314b0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:44.888865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:44.889745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.890028 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.890303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] PATH_INFO: `/v3/projects/d726932934724d79a568758df7cb7b33/users/7a3b4ddf76cd4c5d96eaf02214b35ad0/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.905490 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d726932934724d79a568758df7cb7b33, user_id=7a3b4ddf76cd4c5d96eaf02214b35ad0, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:44.908163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:44.920526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1415/2815] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:44 2022] PUT /identity/v3/projects/d726932934724d79a568758df7cb7b33/users/7a3b4ddf76cd4c5d96eaf02214b35ad0/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:44.925903 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff22a0-54a4-4fe0-97df-dd1aea24aaac None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:44.926239 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff22a0-54a4-4fe0-97df-dd1aea24aaac None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:44.926589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff22a0-54a4-4fe0-97df-dd1aea24aaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:44.945124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-42ff22a0-54a4-4fe0-97df-dd1aea24aaac None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:44.946261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-42ff22a0-54a4-4fe0-97df-dd1aea24aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:45.003583 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1401/2816] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 14:01:45.013941 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:45.015812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:45.071841 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369cb41a-2a94-487c-9e69-302b8e3aaadb admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:45.075479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:45.076127 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:45.076413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:45.076693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:45.086183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:45.087648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:45.097161 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1416/2817] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:45.687364 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:45.687887 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:45.687988 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:45.713652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] MFA Rules not processed for user `7a3b4ddf76cd4c5d96eaf02214b35ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:45.714848 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:45.760989 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:45.782262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1402/2818] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:45.787969 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:45.799046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cbaa4-3e48-4f0c-a029-edfa78aeb594 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:45.804328 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:45.805242 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:45.805634 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:45.806012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:45.806863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:45.808968 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:45.836740 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1417/2819] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:01:45 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:01:45.840832 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:45.856501 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cfaa3-3cb9-466a-bc11-fbd538c64ad8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:45.913324 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:45.914338 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:45.914630 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:45.914937 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:45.915682 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:45.917631 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:45.937092 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1403/2820] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:01:45 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:01:45.941641 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:45.951683 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86589624-51f5-4692-9e2f-e2fcd9ad1730 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:45.956784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:45.957430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:45.957718 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:45.957993 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:45.958708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:45.960322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:45.970803 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1418/2821] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:45.974699 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:45.984453 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72879c2-f14b-43f8-864b-73ee72791f2d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:45.989059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:45.989931 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:45.990216 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:45.990492 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] PATH_INFO: `/v3/projects/14eaba36f7a64d17b687b2b2129b4816/users/9ec64bac150b45f198634eb9b97aa805/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:46.005199 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eaba36f7a64d17b687b2b2129b4816, user_id=9ec64bac150b45f198634eb9b97aa805, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:46.008154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:46.021166 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1404/2822] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:45 2022] PUT /identity/v3/projects/14eaba36f7a64d17b687b2b2129b4816/users/9ec64bac150b45f198634eb9b97aa805/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 14:01:46.024899 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:46.034555 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54179236-3cc7-4820-adb1-9c795a22fbf6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:46.042090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:46.091299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859c40f-184c-4944-b489-1116ca88186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:46.092239 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c40f-184c-4944-b489-1116ca88186b admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:46.092532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c40f-184c-4944-b489-1116ca88186b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:46.092811 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859c40f-184c-4944-b489-1116ca88186b admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:46.093528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859c40f-184c-4944-b489-1116ca88186b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:46.095118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859c40f-184c-4944-b489-1116ca88186b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:46.104612 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1419/2823] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:01:46.108851 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:46.119572 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99d7a9-b01f-43e5-94e5-c9e7359bc47d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:46.124162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79927f49-8785-41a8-a7bf-0800835ba21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:46.125034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79927f49-8785-41a8-a7bf-0800835ba21e admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:46.125317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79927f49-8785-41a8-a7bf-0800835ba21e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:46.125590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79927f49-8785-41a8-a7bf-0800835ba21e admin admin] PATH_INFO: `/v3/projects/14eaba36f7a64d17b687b2b2129b4816/users/9ec64bac150b45f198634eb9b97aa805/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:46.127603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79927f49-8785-41a8-a7bf-0800835ba21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14eaba36f7a64d17b687b2b2129b4816, user_id=9ec64bac150b45f198634eb9b97aa805, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:46.130814 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79927f49-8785-41a8-a7bf-0800835ba21e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:46.140957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1405/2824] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:01:46 2022] PUT /identity/v3/projects/14eaba36f7a64d17b687b2b2129b4816/users/9ec64bac150b45f198634eb9b97aa805/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:01:46.729749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:46.730045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:46.730323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:46.756458 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] MFA Rules not processed for user `9ec64bac150b45f198634eb9b97aa805`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:46.757662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:46.831839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1420/2825] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:46.898234 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:46.898759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:46.898759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:46.917468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] MFA Rules not processed for user `7a3b4ddf76cd4c5d96eaf02214b35ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:01:46.918706 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:46.976758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1406/2826] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:01:46.989638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:01:46.991505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:01:47.066673 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422db2a-3633-4b0b-b7f7-eaa8d9483930 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:01:47.072143 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:01:47.072789 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:01:47.073072 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:01:47.073348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:01:47.081658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:01:47.083232 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:01:47.092444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1421/2827] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:01:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:01:56.969213 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:01:57.088007 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:00.103404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:00.104806 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:00.160425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c71e8-0fe3-4017-b81f-2e5976ceadad None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:00.163944 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:00.164579 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:00.164952 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:00.165129 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:00.173827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:00.175258 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:00.184554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1407/2828] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:00 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:00.885768 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:00.887197 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:00.943303 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751eb6db-82f1-4ec3-b622-63f706dc4cd8 service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:00.946864 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:00.947551 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:00.947835 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:00.948123 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:00.949852 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:00.962661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:00.964114 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:00.975662 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1422/2829] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:02.144672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:02.153897 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c5c7e-23e3-4276-b4a1-58133f3d4ead service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:02.157403 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:02.158029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:02.158311 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:02.158584 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:02.160839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:02.173907 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:02.175968 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:02.186615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1408/2830] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:10.970194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=26 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:12.181955 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=32 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:17.975504 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:17.976913 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:18.054187 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c644c8e-3ff5-4383-a41f-c67468a71242 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:18.059694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:18.060405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:18.060770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:18.061129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:18.063759 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:18.077506 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:18.079273 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:18.091688 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1423/2831] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 14:02:18.553554 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:18.615651 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2dc9e-8fe5-4e99-95ca-61f49397ee54 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:18.620317 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:18.621176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:18.621456 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:18.621726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] PATH_INFO: `/v3/users/7a3b4ddf76cd4c5d96eaf02214b35ad0` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:18.622912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3b4ddf76cd4c5d96eaf02214b35ad0)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:18.624854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:18.670203 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3b4ddf76cd4c5d96eaf02214b35ad0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:18.670844 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3b4ddf76cd4c5d96eaf02214b35ad0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:18.678413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3b4ddf76cd4c5d96eaf02214b35ad0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:18.679034 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3b4ddf76cd4c5d96eaf02214b35ad0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:18.690718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3b4ddf76cd4c5d96eaf02214b35ad0'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:18.702916 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1409/2832] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:02:18 2022] DELETE /identity/v3/users/7a3b4ddf76cd4c5d96eaf02214b35ad0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:18.875701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:18.889793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf2618-b452-47c9-b7ef-a5ac78790a78 service placement] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:18.947433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:18.948313 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:18.948595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:18.948868 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] PATH_INFO: `/v3/projects/d726932934724d79a568758df7cb7b33` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:18.950055 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d726932934724d79a568758df7cb7b33)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:18.952000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:18.996965 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd726932934724d79a568758df7cb7b33', 'request_id': 'req-36f2c664-efcd-496f-97c8-906a2e88168a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.002918 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd726932934724d79a568758df7cb7b33', 'request_id': 'req-36f2c664-efcd-496f-97c8-906a2e88168a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.010183 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd726932934724d79a568758df7cb7b33', 'request_id': 'req-36f2c664-efcd-496f-97c8-906a2e88168a'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.020838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] The token cache is being invalidate because project d726932934724d79a568758df7cb7b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:02:19.021124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.021739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.023270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1424/2833] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:02:18 2022] DELETE /identity/v3/projects/d726932934724d79a568758df7cb7b33 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:19.027301 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.028738 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:19.042316 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214c45c4-7afb-4588-8b26-6c7770e6fc37 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.095870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.096725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.097594 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.097863 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] PATH_INFO: `/v3/users/9ec64bac150b45f198634eb9b97aa805` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.099025 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec64bac150b45f198634eb9b97aa805)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.100967 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.121289 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:19.147157 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec64bac150b45f198634eb9b97aa805'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.147822 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec64bac150b45f198634eb9b97aa805'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.154719 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec64bac150b45f198634eb9b97aa805'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.155379 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec64bac150b45f198634eb9b97aa805'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.167865 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-4b469ff1-b2fd-4dff-bab3-010573558445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec64bac150b45f198634eb9b97aa805'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.180036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1410/2834] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:02:19 2022] DELETE /identity/v3/users/9ec64bac150b45f198634eb9b97aa805 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:19.353455 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.354925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:19.368951 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2c664-efcd-496f-97c8-906a2e88168a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.389741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:19.430456 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.431312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.431625 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.431902 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] PATH_INFO: `/v3/projects/14eaba36f7a64d17b687b2b2129b4816` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.433078 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=14eaba36f7a64d17b687b2b2129b4816)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.434985 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.479877 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14eaba36f7a64d17b687b2b2129b4816', 'request_id': 'req-01f0734e-1ab1-47f8-bac7-514200048f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.485745 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14eaba36f7a64d17b687b2b2129b4816', 'request_id': 'req-01f0734e-1ab1-47f8-bac7-514200048f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.492797 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14eaba36f7a64d17b687b2b2129b4816', 'request_id': 'req-01f0734e-1ab1-47f8-bac7-514200048f8f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.503775 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] The token cache is being invalidate because project 14eaba36f7a64d17b687b2b2129b4816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:02:19.504067 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.504699 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-01f0734e-1ab1-47f8-bac7-514200048f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:19.506229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1425/2835] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:02:19 2022] DELETE /identity/v3/projects/14eaba36f7a64d17b687b2b2129b4816 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:19.511096 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.511411 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.511693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.529956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:19.531172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:19.588482 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1411/2836] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:19.596226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.596520 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.596801 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.614878 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:19.617235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:19.625174 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1426/2837] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:19.629790 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.639681 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91127fc1-2d90-4186-b8e0-0e95a443f913 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.645207 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.645869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.646148 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.646425 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.647151 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:02:19.647484 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.649068 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.660373 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1412/2838] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 14:02:19.664617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.673828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b837b-7807-4260-8542-0c9798a99182 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.678398 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.679044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.679342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.680369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.680369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.682225 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.713106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1427/2839] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:02:19 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:02:19.714506 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.724649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387328e-d10f-4b96-9309-e3aca1d5e48a admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.779397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.780059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.780343 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.780615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.781304 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.783192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.803123 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1413/2840] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:02:19 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:02:19.807305 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.818406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024e26d-96ab-4d80-b917-4327e3bdb92c admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.823046 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.823741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.824035 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.824312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.825041 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.826635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.837151 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1428/2841] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:02:19.841131 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.852051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca6c5-0c71-4bd4-b325-f951cc977e1d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.856979 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b3b4d-1384-40b9-b1ce-99836bf65a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.857643 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b3b4d-1384-40b9-b1ce-99836bf65a5c admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.857927 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b3b4d-1384-40b9-b1ce-99836bf65a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.858202 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b3b4d-1384-40b9-b1ce-99836bf65a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.858935 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b3b4d-1384-40b9-b1ce-99836bf65a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.860564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b3b4d-1384-40b9-b1ce-99836bf65a5c admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.871053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1414/2842] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:02:19.875277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:19.885727 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e4768-41f2-4625-a2c9-0fd5653427e2 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:19.890218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:19.891090 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.891405 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.891685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] PATH_INFO: `/v3/projects/3b165b3b018d4fa190aec1b251f18012/users/dbf088852dc948738dc11a32d5cffe42/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.907838 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b165b3b018d4fa190aec1b251f18012, user_id=dbf088852dc948738dc11a32d5cffe42, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:19.910516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:19.923401 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1429/2843] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:02:19 2022] PUT /identity/v3/projects/3b165b3b018d4fa190aec1b251f18012/users/dbf088852dc948738dc11a32d5cffe42/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:19.934736 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:19.935075 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:19.935383 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:19.943111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:19.964215 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] MFA Rules not processed for user `dbf088852dc948738dc11a32d5cffe42`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:19.965419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:20.027397 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1415/2844] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:20.031917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.078447 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:20.094119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee536f-7b1a-4fd0-8cf0-e72bdd595349 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.098712 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.099387 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.099676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.099955 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.100638 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.102539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.127917 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1430/2845] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:02:20 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:02:20.132530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.143048 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0b89-f31a-4782-97bf-d4304f7226f0 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.196801 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.197459 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.197741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.198021 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.198692 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.200632 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.219143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1416/2846] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:02:20 2022] POST /identity/v3/users => generated 299 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:02:20.223606 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.233937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcfc2f1-6f9e-462d-bf9f-e5f454f45076 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.239677 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.240336 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.240628 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.240908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.241635 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.243433 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.253928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1431/2847] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:02:20.257919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.267615 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67b905-121a-4e7f-ad2b-07464f3cd8a5 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.272130 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.272994 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.273273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.273542 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] PATH_INFO: `/v3/projects/db664fba9f304f7b914c9d3f37a141c3/users/0be6b724128144f78acdf28eacc1113f/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.288146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db664fba9f304f7b914c9d3f37a141c3, user_id=0be6b724128144f78acdf28eacc1113f, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.290789 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.303742 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1417/2848] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:02:20 2022] PUT /identity/v3/projects/db664fba9f304f7b914c9d3f37a141c3/users/0be6b724128144f78acdf28eacc1113f/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:20.307524 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.317472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf17db4-bb13-4a15-b28e-6a19f93ae26a admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.372925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b235f-89d5-4c48-b935-14fee9f447bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.373589 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b235f-89d5-4c48-b935-14fee9f447bb admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.373876 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b235f-89d5-4c48-b935-14fee9f447bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.374158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b235f-89d5-4c48-b935-14fee9f447bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.374887 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b235f-89d5-4c48-b935-14fee9f447bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.376516 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b235f-89d5-4c48-b935-14fee9f447bb admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.386234 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1432/2849] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:02:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:02:20.390153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.400227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dda7c3-bfec-4f5c-9492-cd1ad7c1cb48 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.404733 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.405603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.406307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.406307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] PATH_INFO: `/v3/projects/db664fba9f304f7b914c9d3f37a141c3/users/0be6b724128144f78acdf28eacc1113f/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.408294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db664fba9f304f7b914c9d3f37a141c3, user_id=0be6b724128144f78acdf28eacc1113f, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.411267 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.421588 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1418/2850] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:02:20 2022] PUT /identity/v3/projects/db664fba9f304f7b914c9d3f37a141c3/users/0be6b724128144f78acdf28eacc1113f/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:20.432076 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.432377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.432661 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.458500 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] MFA Rules not processed for user `0be6b724128144f78acdf28eacc1113f`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:20.459739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:20.526099 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1433/2851] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:20.537325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:20.539020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:20.590283 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:20.596532 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db3c46-7b66-49ad-9aab-3550afb57179 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:20.601253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:20.601899 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:20.602187 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:20.602468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:20.664125 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:20.665564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:20.674340 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1419/2852] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:24.802281 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:24.803846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:24.816626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b05428-2781-4210-8f86-2fc12c659e6c None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:24.820129 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222703e4-bb3b-44c4-9e8b-063e653cf3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:24.820769 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222703e4-bb3b-44c4-9e8b-063e653cf3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:24.821052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222703e4-bb3b-44c4-9e8b-063e653cf3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:24.821335 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222703e4-bb3b-44c4-9e8b-063e653cf3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:24.830077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222703e4-bb3b-44c4-9e8b-063e653cf3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:24.832153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222703e4-bb3b-44c4-9e8b-063e653cf3c5 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:24.841657 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1434/2853] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:29.681463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:29.743759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41a72-f069-4b6d-b003-820528f99bb9 service cinder] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:29.748254 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:29.749113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:29.749393 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:29.749666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] PATH_INFO: `/v3/users/dbf088852dc948738dc11a32d5cffe42` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:29.750839 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf088852dc948738dc11a32d5cffe42)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:29.752857 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:29.797919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf088852dc948738dc11a32d5cffe42'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:29.798564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf088852dc948738dc11a32d5cffe42'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:29.805843 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf088852dc948738dc11a32d5cffe42'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:29.806472 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf088852dc948738dc11a32d5cffe42'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:29.819143 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf088852dc948738dc11a32d5cffe42'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:29.836722 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1420/2854] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:02:29 2022] DELETE /identity/v3/users/dbf088852dc948738dc11a32d5cffe42 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:29.841254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:29.841715 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:29.841848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:29.860776 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:29.861995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:29.885479 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:29.919742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1435/2855] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:29.930111 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:29.931598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:29.953063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:29.989181 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a0d1b-a022-4293-9d1f-8cb8d8f9d30f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:29.992775 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:29.993414 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:29.993693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:29.993970 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:30.002718 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:30.004165 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:30.013387 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1421/2856] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:30.275116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:30.276570 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:30.289211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae638fe-dcab-45c1-85f3-bed471a76b1e None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:30.294077 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:30.295018 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:30.295308 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:30.295610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] PATH_INFO: `/v3/projects/3b165b3b018d4fa190aec1b251f18012` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:30.296807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b165b3b018d4fa190aec1b251f18012)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:30.298719 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:30.350995 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b165b3b018d4fa190aec1b251f18012', 'request_id': 'req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.357212 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b165b3b018d4fa190aec1b251f18012', 'request_id': 'req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.364229 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b165b3b018d4fa190aec1b251f18012', 'request_id': 'req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.374445 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] The token cache is being invalidate because project 3b165b3b018d4fa190aec1b251f18012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:02:30.374733 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.375391 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.376933 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1436/2857] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:02:30 2022] DELETE /identity/v3/projects/3b165b3b018d4fa190aec1b251f18012 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:30.380902 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:30.390285 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8efb8c-df30-4343-964b-6c753c293965 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:30.444445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:30.445310 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:30.445593 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:30.445870 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] PATH_INFO: `/v3/users/0be6b724128144f78acdf28eacc1113f` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:30.447038 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0be6b724128144f78acdf28eacc1113f)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:30.449041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:30.493433 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0be6b724128144f78acdf28eacc1113f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.494062 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0be6b724128144f78acdf28eacc1113f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.500950 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0be6b724128144f78acdf28eacc1113f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.501565 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0be6b724128144f78acdf28eacc1113f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.512910 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-2505f795-d14a-4a1f-8ccb-ac5b909fe4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0be6b724128144f78acdf28eacc1113f'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.526099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1422/2858] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:02:30 2022] DELETE /identity/v3/users/0be6b724128144f78acdf28eacc1113f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:30.791626 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:30.793254 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:30.808957 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fa95d-8e12-4d62-8aee-6d1086f9ee2b admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:30.866508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:30.867415 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:30.867704 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:30.867981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] PATH_INFO: `/v3/projects/db664fba9f304f7b914c9d3f37a141c3` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:30.869158 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db664fba9f304f7b914c9d3f37a141c3)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:30.871080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:30.916929 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db664fba9f304f7b914c9d3f37a141c3', 'request_id': 'req-669d9127-d0e7-4eab-b886-265c1fc2b67e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.922891 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db664fba9f304f7b914c9d3f37a141c3', 'request_id': 'req-669d9127-d0e7-4eab-b886-265c1fc2b67e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.924539 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:30.933194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db664fba9f304f7b914c9d3f37a141c3', 'request_id': 'req-669d9127-d0e7-4eab-b886-265c1fc2b67e'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.945207 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] The token cache is being invalidate because project db664fba9f304f7b914c9d3f37a141c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:02:30.945496 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.946133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-669d9127-d0e7-4eab-b886-265c1fc2b67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:30.947865 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1437/2859] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:02:30 2022] DELETE /identity/v3/projects/db664fba9f304f7b914c9d3f37a141c3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:30.954017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:30.954515 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:30.954623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:30.973180 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:30.974313 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:31.011605 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:31.034071 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1423/2860] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:31.042270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.042563 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.042839 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.061260 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:31.062466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:31.070904 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1438/2861] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:31.074869 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.084273 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1ae72-0d82-4fe4-8e54-d753bcc2890a None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.088765 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.089413 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.089698 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.089976 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.090703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:02:31.091036 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.092919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.104167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1424/2862] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 14:02:31.108188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.117793 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129fcae-06d3-4a59-88e4-f1b5acdb6555 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.122360 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.123005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.123297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.123613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.124312 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.126210 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.152121 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1439/2863] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:02:31 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:02:31.155744 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.165457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eab5b-0f75-4390-a564-a2c39365bc6f admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.220100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.220754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.221037 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.221312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.222030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.224022 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.243788 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1425/2864] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:02:31 2022] POST /identity/v3/users => generated 285 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:02:31.247807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.259056 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9ae1ea-eeb1-45f0-8e1f-e5bfdd0f59e2 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.263703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.264376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.264648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.264930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.265652 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.267247 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.277535 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1440/2865] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:02:31.281170 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.290962 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9358449-e4af-4e74-bbc9-bb800e0f0e4d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.295564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39997ae6-7c7e-4e29-9ccb-f55725e0090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.296209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997ae6-7c7e-4e29-9ccb-f55725e0090d admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.296493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997ae6-7c7e-4e29-9ccb-f55725e0090d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.296766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39997ae6-7c7e-4e29-9ccb-f55725e0090d admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.297483 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39997ae6-7c7e-4e29-9ccb-f55725e0090d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.299052 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39997ae6-7c7e-4e29-9ccb-f55725e0090d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.309248 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1426/2866] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:02:31.312978 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.323340 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3051f8-65d1-4cf6-8075-0257170ca008 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.327992 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.328863 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.329149 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.329430 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] PATH_INFO: `/v3/projects/c358e0fa9b8f4ff282c34fb4e31338ec/users/f9d8aa00867e45fcac621f8866d8c8d8/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.344337 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c358e0fa9b8f4ff282c34fb4e31338ec, user_id=f9d8aa00867e45fcac621f8866d8c8d8, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.347538 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.360115 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1441/2867] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:02:31 2022] PUT /identity/v3/projects/c358e0fa9b8f4ff282c34fb4e31338ec/users/f9d8aa00867e45fcac621f8866d8c8d8/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:31.372726 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.373018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.373292 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.398919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] MFA Rules not processed for user `f9d8aa00867e45fcac621f8866d8c8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:31.400146 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:31.462998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1427/2868] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:31.475529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:31.477133 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:31.559949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc73a6-edf7-4d44-84b1-a9cb514fee6f admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:31.563735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b3ad1-dc63-4e61-8726-678ccdab9096 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9625fcd053644e3914df6762e067788', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:31.564408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b3ad1-dc63-4e61-8726-678ccdab9096 service glance] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:31.564693 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b3ad1-dc63-4e61-8726-678ccdab9096 service glance] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:31.564967 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b3ad1-dc63-4e61-8726-678ccdab9096 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:31.573233 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b3ad1-dc63-4e61-8726-678ccdab9096 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:31.574653 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b3ad1-dc63-4e61-8726-678ccdab9096 service glance] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:31.583450 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1442/2869] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:02:41.460100 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:41.579529 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=66 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:02:59.420271 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:59.601867 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd90c-803d-4391-b33f-91f50e64ff13 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:59.606320 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:59.607161 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:59.607540 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:59.607820 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] PATH_INFO: `/v3/users/f9d8aa00867e45fcac621f8866d8c8d8` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:59.608990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d8aa00867e45fcac621f8866d8c8d8)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:59.610866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:59.655164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d8aa00867e45fcac621f8866d8c8d8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:59.655758 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d8aa00867e45fcac621f8866d8c8d8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:59.662644 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d8aa00867e45fcac621f8866d8c8d8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:59.663275 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d8aa00867e45fcac621f8866d8c8d8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:59.674799 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d8aa00867e45fcac621f8866d8c8d8'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:02:59.687173 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1428/2870] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:02:59 2022] DELETE /identity/v3/users/f9d8aa00867e45fcac621f8866d8c8d8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:02:59.691861 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:59.692356 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:59.692467 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:59.710066 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:02:59.711264 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:59.768416 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1443/2871] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:02:59.778177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:02:59.779669 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:02:59.836889 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24795ffe-159e-4fdf-9cf3-056186db2b85 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:02:59.840530 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a0d13-d360-4486-bdbe-542cfdf2f8d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:02:59.841175 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a0d13-d360-4486-bdbe-542cfdf2f8d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:02:59.841461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a0d13-d360-4486-bdbe-542cfdf2f8d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:02:59.841741 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a0d13-d360-4486-bdbe-542cfdf2f8d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:02:59.850896 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a0d13-d360-4486-bdbe-542cfdf2f8d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:02:59.852359 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a0d13-d360-4486-bdbe-542cfdf2f8d7 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:02:59.862209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1429/2872] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:02:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:00.119809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.121810 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:00.134532 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bbee15-6b08-4921-a183-95f4d1f30f47 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.139358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.140209 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.140492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.140770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] PATH_INFO: `/v3/projects/c358e0fa9b8f4ff282c34fb4e31338ec` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.142000 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c358e0fa9b8f4ff282c34fb4e31338ec)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.144180 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.191283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c358e0fa9b8f4ff282c34fb4e31338ec', 'request_id': 'req-2209ca56-d9c6-457e-aaf9-29696774c26b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:00.197297 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c358e0fa9b8f4ff282c34fb4e31338ec', 'request_id': 'req-2209ca56-d9c6-457e-aaf9-29696774c26b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:00.204609 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c358e0fa9b8f4ff282c34fb4e31338ec', 'request_id': 'req-2209ca56-d9c6-457e-aaf9-29696774c26b'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:00.215093 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] The token cache is being invalidate because project c358e0fa9b8f4ff282c34fb4e31338ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:03:00.215526 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:00.216154 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-2209ca56-d9c6-457e-aaf9-29696774c26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:00.217948 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1444/2873] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:03:00 2022] DELETE /identity/v3/projects/c358e0fa9b8f4ff282c34fb4e31338ec => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:03:00.222762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.223055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.223363 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.241240 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:00.242421 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:00.259017 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:00.302077 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1430/2874] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:00.309742 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.310039 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.310322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.328199 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:00.329408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:00.337290 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1445/2875] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:00.341731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.351434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5c797-a1f1-4e32-942a-142473c01de8 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.356759 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.357404 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.357689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.357964 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.358686 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:03:00.358990 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.360606 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.371793 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1431/2876] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 14:03:00.375851 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.384847 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51c0f6-a877-4548-8d17-eaba2abf97c2 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.389432 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.390069 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.390355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.390637 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.391348 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.393282 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.419089 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1446/2877] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:03:00 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:03:00.423329 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.434360 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c2f47-1d0f-4986-a6d2-5f076d121909 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.490120 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.490725 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.491014 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.491293 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.492030 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.493957 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.513986 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1432/2878] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:03:00 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:03:00.518159 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.528884 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359b572-af21-476b-a060-63ee30e6b46d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.533435 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.534086 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.534369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.534643 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.535457 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.537037 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.550842 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1447/2879] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:03:00.554754 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.564564 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0846832-0dd0-4d36-9db9-e13be3dfd9a9 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.569081 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15855c-9df1-4b5d-86ec-b04804f2e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.569723 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15855c-9df1-4b5d-86ec-b04804f2e4cf admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.570006 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15855c-9df1-4b5d-86ec-b04804f2e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.570281 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15855c-9df1-4b5d-86ec-b04804f2e4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.570996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15855c-9df1-4b5d-86ec-b04804f2e4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.573133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15855c-9df1-4b5d-86ec-b04804f2e4cf admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.582708 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1433/2880] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:03:00.586644 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.597322 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1f9fa-43c6-4290-b8f0-29ecb998b5c0 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.601815 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.602668 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.602949 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.603238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] PATH_INFO: `/v3/projects/38427d286ecb4c56bd4aa05ca6f845cb/users/53b0f815236a416cb0858996d44bb840/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.617584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38427d286ecb4c56bd4aa05ca6f845cb, user_id=53b0f815236a416cb0858996d44bb840, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.620317 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.632515 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1448/2881] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:03:00 2022] PUT /identity/v3/projects/38427d286ecb4c56bd4aa05ca6f845cb/users/53b0f815236a416cb0858996d44bb840/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 14:03:00.644211 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04628234-8670-41ef-a026-e6c1aa691683 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.644500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04628234-8670-41ef-a026-e6c1aa691683 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.644767 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04628234-8670-41ef-a026-e6c1aa691683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.671070 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-04628234-8670-41ef-a026-e6c1aa691683 None None] MFA Rules not processed for user `53b0f815236a416cb0858996d44bb840`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:00.672319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-04628234-8670-41ef-a026-e6c1aa691683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:00.734737 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1434/2882] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:00.745228 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:00.746827 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:00.769382 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:00.806395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242d50d-646f-4cfe-ad30-8193bf838fe6 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:00.810848 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '695790c0f33f40e1a0ea7e70318d419a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:00.811531 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:00.811812 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:00.812088 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:00.820369 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:00.821804 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:00.831200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1449/2883] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:02.161410 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b542b81-2cb0-4244-806b-68c6250d9fdd None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:02.161912 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b542b81-2cb0-4244-806b-68c6250d9fdd None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:02.162018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b542b81-2cb0-4244-806b-68c6250d9fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:02.179086 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-5b542b81-2cb0-4244-806b-68c6250d9fdd None None] MFA Rules not processed for user `53b0f815236a416cb0858996d44bb840`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:02.180312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5b542b81-2cb0-4244-806b-68c6250d9fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:02.186939 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1435/2884] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:08.319583 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:08.321038 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:08.379749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb58f7-243e-4304-9e17-cd4dfea5a597 service cinder] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:08.383299 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:08.383981 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:08.384261 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:08.384542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:08.386945 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:08.396987 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:08.398446 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:08.408601 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1450/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:12.173831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:17.018687 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f635f8-a37e-4bb0-927c-3d601549a09e None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:17.019272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f635f8-a37e-4bb0-927c-3d601549a09e None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:17.019272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f635f8-a37e-4bb0-927c-3d601549a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:17.075262 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-11f635f8-a37e-4bb0-927c-3d601549a09e None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:17.076423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-11f635f8-a37e-4bb0-927c-3d601549a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:17.137528 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1436/2886] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:17.181471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:17.183528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:17.273406 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb29ce-953f-4cef-bc2d-6684d50c32c6 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:17.279005 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:17.279694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:17.279980 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:17.280257 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:17.288270 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:17.289853 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:17.298576 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1451/2887] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 14:03:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 14:03:17.775597 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fc1a-46bb-4866-bdb2-97f49c5b07d2 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:17.775891 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fc1a-46bb-4866-bdb2-97f49c5b07d2 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:17.776879 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8fc1a-46bb-4866-bdb2-97f49c5b07d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:17.794589 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-b4d8fc1a-46bb-4866-bdb2-97f49c5b07d2 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:17.795815 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-b4d8fc1a-46bb-4866-bdb2-97f49c5b07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:17.802901 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1437/2888] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 14:03:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:17.814922 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:17.825928 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb7d7f-adb6-4112-b19e-fb2f56411892 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:17.830950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:17.831613 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:17.831900 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:17.832179 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:17.840914 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:17.842474 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:17.850855 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1452/2889] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 14:03:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 14:03:18.032748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f116d-4bef-45e6-8849-ad09bb7e5031 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:18.033252 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f116d-4bef-45e6-8849-ad09bb7e5031 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:18.033349 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f116d-4bef-45e6-8849-ad09bb7e5031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:18.050172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-977f116d-4bef-45e6-8849-ad09bb7e5031 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:18.051366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-977f116d-4bef-45e6-8849-ad09bb7e5031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:18.058805 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1438/2890] 10.222.0.25 () {58 vars in 1009 bytes} [Wed Jul 6 14:03:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:18.070245 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:18.081283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012599e8-ac3e-4a36-974b-94ed7c75aaa8 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:18.086292 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:18.086925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:18.087213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:18.087522 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:18.095894 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:18.097408 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:18.105656 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1453/2891] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 14:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 14:03:18.410552 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:18.410842 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:18.411117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:18.428529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] MFA Rules not processed for user `a2fb070e53534372a7aa767e458aebfe`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:18.429730 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:18.437336 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1439/2892] 10.222.0.25 () {58 vars in 967 bytes} [Wed Jul 6 14:03:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:18.449163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:18.459596 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323573f4-22a3-442b-8d6a-b06dba8b88a3 service swift] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:18.464534 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2e189-8bbe-41ac-8d6c-31b2d7baaa29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '497f17edb85d4ed999f24690f5bc0ff1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:18.465163 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e189-8bbe-41ac-8d6c-31b2d7baaa29 service swift] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:18.465448 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e189-8bbe-41ac-8d6c-31b2d7baaa29 service swift] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:18.465725 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2e189-8bbe-41ac-8d6c-31b2d7baaa29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:18.471843 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=100 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:18.474176 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2e189-8bbe-41ac-8d6c-31b2d7baaa29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:18.476283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2e189-8bbe-41ac-8d6c-31b2d7baaa29 service swift] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:18.484905 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1454/2893] 10.222.0.25 () {60 vars in 1384 bytes} [Wed Jul 6 14:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 14:03:20.502943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:20.563192 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9798c6e-32f0-4379-b08c-21f95585e0d7 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:20.567650 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:20.568508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:20.568792 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:20.569066 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] PATH_INFO: `/v3/users/53b0f815236a416cb0858996d44bb840` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:20.570227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b0f815236a416cb0858996d44bb840)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:20.572169 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:20.615136 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:20.616740 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b0f815236a416cb0858996d44bb840'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:20.617470 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b0f815236a416cb0858996d44bb840'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:20.625434 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b0f815236a416cb0858996d44bb840'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:20.626063 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b0f815236a416cb0858996d44bb840'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:20.638194 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b0f815236a416cb0858996d44bb840'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:20.650032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1440/2894] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:03:20 2022] DELETE /identity/v3/users/53b0f815236a416cb0858996d44bb840 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:03:20.654679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:20.655175 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:20.655286 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:20.672566 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:20.673749 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:20.731528 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1455/2895] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:20.741200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:20.742590 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:20.798309 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5db11-ac59-4256-95e9-b32daab566c1 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:20.801875 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58ff91e-0b05-45c4-8be3-bc8cb52e11bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:20.802519 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ff91e-0b05-45c4-8be3-bc8cb52e11bd service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:20.802802 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ff91e-0b05-45c4-8be3-bc8cb52e11bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:20.803079 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58ff91e-0b05-45c4-8be3-bc8cb52e11bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:20.812854 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ff91e-0b05-45c4-8be3-bc8cb52e11bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:20.814341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58ff91e-0b05-45c4-8be3-bc8cb52e11bd service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:20.823766 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1441/2896] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:20.989512 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:20.990937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:21.004648 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a6203-bb2a-4ae5-a68b-a7fdb0a35f7f None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.009277 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.010140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.010429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.010701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] PATH_INFO: `/v3/projects/38427d286ecb4c56bd4aa05ca6f845cb` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.011973 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38427d286ecb4c56bd4aa05ca6f845cb)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.013934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.059465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38427d286ecb4c56bd4aa05ca6f845cb', 'request_id': 'req-a99bbdb3-d174-49de-b052-002420b0ec13'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:21.065402 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38427d286ecb4c56bd4aa05ca6f845cb', 'request_id': 'req-a99bbdb3-d174-49de-b052-002420b0ec13'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:21.072298 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38427d286ecb4c56bd4aa05ca6f845cb', 'request_id': 'req-a99bbdb3-d174-49de-b052-002420b0ec13'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:21.082309 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] The token cache is being invalidate because project 38427d286ecb4c56bd4aa05ca6f845cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86852) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:03:21.082595 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:21.083213 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-a99bbdb3-d174-49de-b052-002420b0ec13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:03:21.084744 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1456/2897] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:03:20 2022] DELETE /identity/v3/projects/38427d286ecb4c56bd4aa05ca6f845cb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:03:21.090461 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.090748 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.091045 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.109840 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:21.111069 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:21.170177 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1442/2898] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:21.178480 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.178770 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.179071 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.196906 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:21.198104 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:21.206296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1457/2899] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:21.210238 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.220357 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b60b84-2a32-4a27-a71e-225340318e4f None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.224831 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.225475 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.225762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.226039 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] PATH_INFO: `/v3/domains` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.226760 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86853) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 14:03:21.227065 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.228689 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.240522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1443/2900] 10.222.0.25 () {58 vars in 1152 bytes} [Wed Jul 6 14:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 14:03:21.244617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.253658 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fcef4-cb98-433b-85a1-817e322ea580 None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.258223 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.258857 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.259139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.259454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.260139 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.262021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.287153 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1458/2901] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:03:21 2022] POST /identity/v3/projects => generated 369 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 14:03:21.291020 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.301449 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85987f85-bfa6-4f80-8511-9a0f624ab995 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.348463 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:21.359099 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.359996 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.360445 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.360963 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.361658 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.363598 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.382437 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1444/2902] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:03:21 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:03:21.387110 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.397243 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb8047-4f15-4dc7-b80e-7a061edafec7 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.401870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.403097 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.403413 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.403697 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.404418 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.406010 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.417193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1459/2903] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:03:21.421029 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.430709 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5d5c8-2dd5-4479-8975-01f1ace7ddca admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.435198 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cadfa-38f9-46c7-9015-7b0d5356df2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.435871 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cadfa-38f9-46c7-9015-7b0d5356df2e admin admin] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.436154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cadfa-38f9-46c7-9015-7b0d5356df2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.436426 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cadfa-38f9-46c7-9015-7b0d5356df2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.437142 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cadfa-38f9-46c7-9015-7b0d5356df2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.438731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cadfa-38f9-46c7-9015-7b0d5356df2e admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.448209 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1445/2904] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 14:03:21.452466 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.462170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dbef0a-e52f-4fa8-9d13-d710baba4b20 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.467237 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.468395 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] REQUEST_METHOD: `PUT` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.468675 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.468950 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] PATH_INFO: `/v3/projects/0bd375bed80544c3a7ea5a46a527c165/users/a667636963de468892d116f3bd3e64b8/roles/3210c522a1f5400695e3e0e1ed6789ef` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.483118 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd375bed80544c3a7ea5a46a527c165, user_id=a667636963de468892d116f3bd3e64b8, role_id=3210c522a1f5400695e3e0e1ed6789ef)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.485809 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.498546 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1460/2905] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:03:21 2022] PUT /identity/v3/projects/0bd375bed80544c3a7ea5a46a527c165/users/a667636963de468892d116f3bd3e64b8/roles/3210c522a1f5400695e3e0e1ed6789ef => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:03:21.503571 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4572-50b1-439f-878e-68ba573019f5 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.504049 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4572-50b1-439f-878e-68ba573019f5 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.504164 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e4572-50b1-439f-878e-68ba573019f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.521469 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-307e4572-50b1-439f-878e-68ba573019f5 None None] MFA Rules not processed for user `72199794cddc4ed1acf251b2e02a7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:21.522649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-307e4572-50b1-439f-878e-68ba573019f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:21.580047 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1446/2906] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 14:03:21.589505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:21.591828 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:21.609888 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:21.648703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20270147-b192-4ffa-9d23-6587678de590 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:21.652870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:21.653542 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:21.653823 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:21.654094 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:21.662984 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:21.664444 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:21.673743 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1461/2907] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:25.296791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.297253 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.297358 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.329660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.auth.core [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] MFA Rules not processed for user `a667636963de468892d116f3bd3e64b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86853) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:25.331074 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:25.406491 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1447/2908] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:25.411113 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:25.421527 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805bdbc-59d5-42cd-b981-fb76f4e17133 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:25.426030 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:25.426698 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.426986 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.427266 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] PATH_INFO: `/v3/projects` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.427991 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:25.429908 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:25.457347 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1462/2909] 10.222.0.25 () {60 vars in 1152 bytes} [Wed Jul 6 14:03:25 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:03:25.461559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:25.473751 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de56b48-b861-4850-871c-4c42d8d553e4 None None] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:25.533055 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:25.533731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] REQUEST_METHOD: `POST` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.534118 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.534282 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] PATH_INFO: `/v3/users` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.534972 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:25.536933 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:25.544773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:25.562633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1448/2910] 10.222.0.25 () {60 vars in 1143 bytes} [Wed Jul 6 14:03:25 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 14:03:25.564022 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:25.575373 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462689b-0aa6-4a0f-8007-576647f184be admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:25.580083 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:25.580761 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.581059 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.581376 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.582112 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:25.583784 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:25.595548 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1463/2911] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:03:25.599773 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:25.610623 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d90bca-65f8-4a4d-8bd1-2bf97f5de58d admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:25.615423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:25.616328 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.616612 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.616919 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] PATH_INFO: `/v3/projects/f5250f4c12584729acc6190401c68331/users/a5137ab30cdd4641b9a582d98458955f/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.633156 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5250f4c12584729acc6190401c68331, user_id=a5137ab30cdd4641b9a582d98458955f, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:25.635860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:25.651294 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1449/2912] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:03:25 2022] PUT /identity/v3/projects/f5250f4c12584729acc6190401c68331/users/a5137ab30cdd4641b9a582d98458955f/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:03:25.655425 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:25.666001 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5867e-9bf6-42e2-9ae6-5a1dbfff3894 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:25.726006 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb45b2-2e08-43de-a90f-235b405ef5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:25.726472 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb45b2-2e08-43de-a90f-235b405ef5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.726764 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb45b2-2e08-43de-a90f-235b405ef5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.727052 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb45b2-2e08-43de-a90f-235b405ef5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.727824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb45b2-2e08-43de-a90f-235b405ef5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:25.729454 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb45b2-2e08-43de-a90f-235b405ef5d1 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:25.740930 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1464/2913] 10.222.0.25 () {58 vars in 1121 bytes} [Wed Jul 6 14:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 14:03:25.744978 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:25.756259 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9ddf0-e371-44f0-aa9e-fd8bd4c44953 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:25.761222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:25.762762 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:25.763108 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:25.763423 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] PATH_INFO: `/v3/projects/f5250f4c12584729acc6190401c68331/users/a5137ab30cdd4641b9a582d98458955f/roles/729660ef64b242119ec8e65a05f1e171` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:25.765451 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5250f4c12584729acc6190401c68331, user_id=a5137ab30cdd4641b9a582d98458955f, role_id=729660ef64b242119ec8e65a05f1e171)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:25.768150 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:25.778827 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1450/2914] 10.222.0.25 () {60 vars in 1482 bytes} [Wed Jul 6 14:03:25 2022] PUT /identity/v3/projects/f5250f4c12584729acc6190401c68331/users/a5137ab30cdd4641b9a582d98458955f/roles/729660ef64b242119ec8e65a05f1e171 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:03:30.451226 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884ba1-98f1-4349-a123-a8a5f4850694 None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:30.451723 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884ba1-98f1-4349-a123-a8a5f4850694 None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:30.451807 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73884ba1-98f1-4349-a123-a8a5f4850694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:30.488074 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-73884ba1-98f1-4349-a123-a8a5f4850694 None None] MFA Rules not processed for user `a5137ab30cdd4641b9a582d98458955f`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:30.490031 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-73884ba1-98f1-4349-a123-a8a5f4850694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:30.592320 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1465/2915] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:30.612053 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:30.614520 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:30.716508 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244bddd-78ea-476f-b8b7-b5477e6f0af3 admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:30.723672 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:30.724735 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:30.725113 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:30.725490 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:30.793064 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:30.795119 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:30.806599 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1451/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:31.820934 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] REQUEST_METHOD: `POST` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:31.821508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:31.821508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:31.834824 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:31.841012 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.auth.core [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] MFA Rules not processed for user `a667636963de468892d116f3bd3e64b8`. Rule list: `[]` (Enabled: `True`). {{(pid=86852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 14:03:31.842218 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:31.849342 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1466/2917] 10.222.0.25 () {58 vars in 957 bytes} [Wed Jul 6 14:03:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 14:03:40.801381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:INSERT=4,keystone:SELECT=73 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:03:48.739178 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:48.740657 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:48.811660 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a3c91-44f4-4ec9-878a-f3730084c1d7 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:48.816664 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:48.817306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:48.817587 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:48.817888 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:48.819670 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:48.830782 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:48.832367 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:48.841980 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1452/2918] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:51.214629 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:51.216326 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:51.239462 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c3315-91dc-4822-b3bc-6b7892b2d6ee None None] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:51.245667 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:51.246559 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:51.246925 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:51.247283 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:51.249636 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:51.263473 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:51.265082 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:51.279470 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1467/2919] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:56.807032 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:56.820500 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921b682-f63a-420f-a6b5-e07aed68a79e service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:56.826121 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:56.826771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:56.827056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:56.827350 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:56.829278 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:56.843679 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:56.845325 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:56.857366 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1453/2920] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:03:59.493138 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:03:59.494586 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:03:59.551492 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8af0bd4-d4d9-44b8-8f5e-3d5d0f0e914b service nova] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:03:59.555044 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:03:59.555731 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:03:59.556021 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:03:59.556304 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:03:59.565870 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:03:59.567429 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:03:59.577901 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1468/2921] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:03:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:04:06.852635 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=38 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:04:09.573338 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=32 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:06:09.365777 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:06:09.376956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977add1-c9e5-47d5-bfee-12f272b03829 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:06:09.381860 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:06:09.382493 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:06:09.382780 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:06:09.383056 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:06:09.384821 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:06:09.396457 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:06:09.398244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:06:09.408652 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1454/2922] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:06:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:06:19.403835 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:06:38.443476 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:06:38.452064 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8eac16-4926-4346-97f4-6bf3e95cf3f4 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:06:38.455571 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:06:38.456200 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:06:38.456483 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:06:38.456760 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:06:38.458508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:06:38.467778 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:06:38.469194 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:06:38.477813 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1469/2923] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:06:38.571570 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:06:38.581440 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96aae08-bddb-4457-997b-b1a99d878fac service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:06:38.585633 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:06:38.586353 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:06:38.586712 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:06:38.586997 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:06:38.588866 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:06:38.599731 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:06:38.601174 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:06:38.609319 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1455/2924] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:06:38.717937 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:06:38.727355 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729450e-db25-44b2-8085-5e322f7f94cb service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:06:38.731124 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:06:38.731897 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:06:38.732054 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:06:38.732465 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:06:38.734080 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:06:38.748084 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:06:38.749505 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:06:38.760236 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1470/2925] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:06:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:06:48.605711 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:06:48.755508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=12 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:08:15.088394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:15.105333 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65eff4-f49b-4ded-acd6-81d2db68cecc service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:15.112008 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943294440c3a4d309ff6e6165dcb9d32', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:15.112956 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:15.113561 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:15.114124 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:15.115998 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:15.130351 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:15.132102 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:15.148212 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1456/2926] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 14:08:15.255692 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:15.267106 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180401d-c765-4fd7-88fd-b39de30f91f7 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:15.269341 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:15.273130 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:15.274296 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:15.274647 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:15.275119 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:15.278850 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:15.280050 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52623e2-ca24-4d87-8ebc-d89e2bec67a2 service nova] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:15.284924 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:15.285603 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:15.285885 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:15.286227 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:15.288051 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:15.290594 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:15.292186 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:15.301846 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1471/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:08:15.302307 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:15.304162 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:15.319176 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1457/2928] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:08:16.516193 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:16.524701 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a990ce6-e098-44d7-8ef1-23b4098fd887 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:16.528272 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:16.528903 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:16.529188 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:16.529471 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:16.531211 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:16.544694 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:16.546111 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:16.557817 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1472/2929] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:08:21.535172 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:21.544159 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3a76c-1c31-409b-9630-875bea331daa service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:21.548394 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0dd5d8814384b14b46e8e6fd4fab9f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:21.549059 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:21.549419 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:21.549693 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:21.620153 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:21.621864 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:21.632354 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1458/2930] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:08:22.081238 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:22.082685 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:22.096816 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec0f65-2c4e-4bd8-b97c-3cab473541c9 service neutron] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:22.101686 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:22.102358 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:22.102646 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:22.102923 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:22.104679 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:22.116004 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:22.117584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:22.129681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1473/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:08:24.926303 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:24.942409 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae98dc65-81fe-415b-830f-74558d0b9686 service neutron] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:24.949323 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:24.950117 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] REQUEST_METHOD: `GET` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:24.950638 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:24.951080 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:24.953381 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:24.967167 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:24.969533 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:24.981934 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1459/2932] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:08:25.243584 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:25.254509 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ad64-f867-4160-ad52-75503710ea9f service placement] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:25.262720 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:25.263678 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:25.263964 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:25.264244 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] PATH_INFO: `/v3/users/a667636963de468892d116f3bd3e64b8` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:25.265486 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a667636963de468892d116f3bd3e64b8)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:25.267508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:25.314140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a667636963de468892d116f3bd3e64b8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.325821 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a667636963de468892d116f3bd3e64b8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.333189 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a667636963de468892d116f3bd3e64b8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.333844 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a667636963de468892d116f3bd3e64b8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.334441 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a667636963de468892d116f3bd3e64b8'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.348045 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1474/2933] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:08:25 2022] DELETE /identity/v3/users/a667636963de468892d116f3bd3e64b8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:08:25.524160 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:25.535478 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68fe0d3-5c35-464b-aea6-634df82184cf service placement] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:25.600468 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:25.601244 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:25.601522 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:25.601791 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] PATH_INFO: `/v3/projects/0bd375bed80544c3a7ea5a46a527c165` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:25.602981 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd375bed80544c3a7ea5a46a527c165)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:25.604943 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:25.650559 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd375bed80544c3a7ea5a46a527c165', 'request_id': 'req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.655041 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:08:25.656272 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd375bed80544c3a7ea5a46a527c165', 'request_id': 'req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.663399 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd375bed80544c3a7ea5a46a527c165', 'request_id': 'req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.675306 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] The token cache is being invalidate because project 0bd375bed80544c3a7ea5a46a527c165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:08:25.675622 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.676312 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.678018 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1460/2934] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:08:25 2022] DELETE /identity/v3/projects/0bd375bed80544c3a7ea5a46a527c165 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:08:25.682235 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:25.683681 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:25.696582 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444917-58f4-414b-a133-ca89531c696d admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:25.752741 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:25.753610 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:25.753893 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:25.754168 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] PATH_INFO: `/v3/users/a5137ab30cdd4641b9a582d98458955f` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:25.755377 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5137ab30cdd4641b9a582d98458955f)` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:25.757323 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:25.802617 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:08:25.814048 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5137ab30cdd4641b9a582d98458955f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.825708 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5137ab30cdd4641b9a582d98458955f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.833484 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5137ab30cdd4641b9a582d98458955f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.834140 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5137ab30cdd4641b9a582d98458955f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.834739 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.notifications [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5137ab30cdd4641b9a582d98458955f'} {{(pid=86852) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:25.847703 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1475/2935] 10.222.0.25 () {58 vars in 1223 bytes} [Wed Jul 6 14:08:25 2022] DELETE /identity/v3/users/a5137ab30cdd4641b9a582d98458955f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:08:26.018666 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Authenticating user token {{(pid=86853) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:08:26.020247 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.fernet_utils [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86853) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:08:26.033133 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0eb438-fe1c-4d62-8ef6-6f2c127e0eee admin admin] Validating token access rules against request {{(pid=86853) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:08:26.089087 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72199794cddc4ed1acf251b2e02a7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3dbd2977ff724d4a80575343d59991ff', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86853) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:08:26.089966 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:08:26.090261 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] SCRIPT_NAME: `/identity` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:08:26.090529 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] PATH_INFO: `/v3/projects/f5250f4c12584729acc6190401c68331` {{(pid=86853) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:08:26.091757 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5250f4c12584729acc6190401c68331)` {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:08:26.093703 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] RBAC: Authorization granted {{(pid=86853) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:08:26.140771 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5250f4c12584729acc6190401c68331', 'request_id': 'req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:26.146154 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5250f4c12584729acc6190401c68331', 'request_id': 'req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:26.152222 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5250f4c12584729acc6190401c68331', 'request_id': 'req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783'} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:26.164224 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] The token cache is being invalidate because project f5250f4c12584729acc6190401c68331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86853) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 14:08:26.164511 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:26.165126 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG keystone.notifications [None req-9fb5cb4b-ab00-4bd6-a143-3e2907f64783 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86853) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 14:08:26.166649 dv-cinder-819149-8-smb devstack@keystone.service[86853]: [pid: 86853|app: 0|req: 1461/2936] 10.222.0.25 () {58 vars in 1232 bytes} [Wed Jul 6 14:08:26 2022] DELETE /identity/v3/projects/f5250f4c12584729acc6190401c68331 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 14:08:35.843585 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:08:36.161200 dv-cinder-819149-8-smb devstack@keystone.service[86853]: DEBUG dbcounter [-] [86853] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=8 {{(pid=86853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 14:11:18.330735 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Authenticating user token {{(pid=86852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 14:11:18.332170 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:11:18.471547 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a779a-4095-4345-9d51-291bb6569149 admin admin] Validating token access rules against request {{(pid=86852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 14:11:18.528507 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b6895073d447cba46fe3569df20081', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '134673dce74a484984ee7674236e10f9', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 14:11:18.529160 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] REQUEST_METHOD: `GET` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 14:11:18.529443 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] SCRIPT_NAME: `/identity` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 14:11:18.529722 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 14:11:18.531510 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.fernet_utils [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 14:11:18.542508 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 14:11:18.544116 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d76fb-5e71-44c7-b572-d0be7147197c service placement] RBAC: Authorization granted {{(pid=86852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 14:11:18.553890 dv-cinder-819149-8-smb devstack@keystone.service[86852]: [pid: 86852|app: 0|req: 1476/2937] 10.222.0.25 () {60 vars in 1365 bytes} [Wed Jul 6 14:11:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 14:11:28.549676 dv-cinder-819149-8-smb devstack@keystone.service[86852]: DEBUG dbcounter [-] [86852] Writing DB stats keystone:SELECT=89 {{(pid=86852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}